I think that's right. With work a fairly average looking person (man or woman) can make themselves overtly attractive - diet, exercise, grooming, clothes, etc. Then of course there's makeup, even cosmetic surgery.
I've seen people transform themselves. It takes time, money and effort though.