I agree with what has already been said. You are not in sin because of your feelings but it may have been wiser to talk it through with Jesus rather than the elder and deacon but that is another lesson learned. From what you say, they sound as though they themselves could have problems. Personally I think people who cannot always handle their own lives very well are more than happy to set down lots of rules for others to follow. We are free because Jesus set us free, do not put yourself back into bondage, His yoke is bearable because He knows what weight we can carry. A question to ask yourself 'Was it the man or his power/situation which attracted you?'
God's promises never fail