Not necessarily. Pure looks don't rate as high for women, as it does for men. Looks are still important, but more towards deportment, posture, movement. Clothing, physique and style as you mentioned as well.
Hard to say without more info about what's going on, but I myself wouldn't date someone...