I agree with you that a man should do what he can to make himself look as good as he can.
But in addition to outright neglect, which is obviously bad, there's the other extreme. If a man starts judging himself according to his looks, then he's either going to end up some flaming metrosexual or an extremely depressed self-hating wuss, neither of which is a good thing to be. Personally, I have no illusions about my looks (which suck), but beating myself up over it doesn't motivate me to make things better.
Perhaps it comes down to motivation - why do you want to look good: for yourself or for women?
Or how much do you think looks matter? Are they everything, or are they just icing on a pvssy-quakingly masculine cake?