While submitting to brethren is scriptural, the Bible also tells us that first, we must submit to God. We look in His word for the things we are to do. I assume your pastor is looking at 1 Timothy 2:8 which says, “the women [should] adorn themselves in modest apparel, not with braided hair or gold or pearls or costly clothing, but which is proper for women professing godliness with good works.” It would be good to compare that with 1 Peter 3:3, “Do not let your adornment be merely outward — arranging the hair, wearing gold, or putting on fine apparel — rather let it be the hidden person of the heart, with the incorruptible beauty of a gentle and quiet spirit, which is very precious in the sight of God.”
It seems that the point is that a Christian woman should not be flashy or showy. It doesn’t imply that we shouldn’t comb our hair nor wear any jewelry.
When it comes to pants, that Scripture comes from the Old Testament. “A woman must not put on men’s clothing, and a man must not wear women’s clothing. Anyone who does this is detestable in the sight of the LORD your God.” Deuteronomy 22:5 This verse is referring to transvestite cross-dressing.
Clothing styles have varied with time and culture. In the times of Jesus, all people wore robes. We can only assume there was some way of knowing which robes were manly and which were feminine. In Scotland, men wore kilts, a kind of skirt.
Therefore, when it comes to deciding if clothing is acceptable to God, ask if the garment is meant for your gender. If people would not confuse you with the opposite gender, then you are acceptable to God. However, each must follow his or her conscience.
Additional Resources:
Christian Questions Podcast Episode #1240: Is It a Sin if I …? (Part I)
Examining whether how we dress and if gambling are sins
Preview Video
CQ Rewind Show Notes
Blog post: Can believers use artificial nails and hairpieces?