I have dated lot's of guys of short or average hieght. Since I am short (5'3) most guys feel bigger than me no matter what their height.
Of my 3 serious boyfriends, one was 5'8, the other 5'9, and my current is 6'4. Though, I wish he was shorter all the time - and tell him so. We look funny together and it is difficult to kiss when we are standing up. Urg.
Anyway, let me tell you a story about the one guy who totally seduced me. Now, if you know anything about me, I am not usually the passive one on the dating scene. A lot of guys ask me out, but I ask about the same amount out as well. I'm pretty straightfoward and know what I want - and go get it a lot of the time. Not so easily seduced - more often the seductress.
Anyway, this guy, Eric, is probably about 5'4 - basically, we are almost the same height. He is nice looking but no model. He was a friend of a friend who I had talked to in a group setting at a few parties, but didn't think very much of. One night, at a bar, he came up and started talking to me - we talked about literature, mostly, with a little bit of sexual innuendo thrown in for good measure. But basically, he was so confident and smart and looked at me so, well, sexually, that I went home that night and couldn't stop thinking about him - and not in a romantic sort of way - more in a sex sort of way.
Anyway, he called me the next day and asked me out. We had a great date, a great makeout session, and great sex a week or so later. We ended up dating casually for about 3-4 months, until the end of the semester.
Anyway, the point of the story is, he was 5'4 and that didn't make a difference to me.
Are all girls like me? No. Some really DO care about height. But who cares? If they do care about height, they will say no when you ask them out which will enable you to move on to other girls who may not care.
But, if you let it effect your self-esteem, that will be your downfall, because most women want a man who is comfortable with who they are.