No person described in section 2866 shall be a member of a parish or religious society without his consent. Any person may dissolve his connection therewith by leaving with its clerk a certificate of his intention to do so, and all his liability for future expenses shall thereby cease; but he may be taxed for money previously raised, except in case of removal from a local parish.