I've seen a lot of swollen guys that are basically virgins. If you spend all your time at the gym then there isn't enough time to make money, develop style or knowledge. You end up being a buffed up guy in terrible clothes, no cash, lousy house, junk car and have nothing to talk about. Yes it would be great to have all and there are exceptions (those with lots of inheritance, sponsor/commerical type) but for the most part it's almost impossible and something has to give.
I've noticed that guys who are well-balanced but still well over average in every aspect are what women want, and also who men want to be. Also you need to remember that when you earn a dollar then it's always going to be there (unless you spend it) but with muscle if you leave it alone then it vanishes.