Wow I have this problem so much. Alot of my friends are AFC (not so much "frustrated" though), and I was one too, and whenever I try to work my game on a group of ladies, they talk to me knowing that I am their best friend, and when girls pick up on the fact that I'm the kid's best friend they begin to get a negative reaction.
I suggest, if you are talking to a group of girls, that you try to nicely draw the line with your CB friend. Ask them to back off a bit when you try to work your game. CB Friends can sometimes be the worst, as your generally friendly reaction towards them would probably make girls think "He hangs out with this AFC (or a deragatory term)?!" Or you can play it off and sorta make fun of him (in a joking way though!) so that he knows you aren't being derisive and girls get a good laugh out of it too.