I used to work at Banana, and I sold to maybe 3% homosexuals. The rest were straight dudes, usually boring dressers, and most of the time they were with their girlfriends/wives. Women like to dress men in BR.
Which brings me to my other point. Women really know nothing about dressing men. The girls who worked at my BR were, by all accounts, stylish girls (a couple did fashion design at college), and couldn't manage to fit a suit to a man, put a shirt and tie together, or whatever. When you go shopping, ask the best-dressed male employee to help you.
Also, if you're worried about looking gay, you're not gonna get very far in fashion, because it's about attitude. I wear the gayest sh¡t around and I used to get called out on it at bars, but now I don't even get that because my reality is so consistent with my style.