Height absolutely matters. It absolutely does. In fact, I think the only limiting factor in how far you can get with women is height, insofar as your dating pool is a bit more limited (some women will rule you out because of it). Literally EVERYTHING else about yourself you can change, both inner and outer - I believe even Pook said this.
But some women won't care, or will look past it, and if you're looking for a woman, these are the kinds you want to get to know.
My inspiration is my roommate. He's a 5'4 indian guy, average to above average looks, super skinny (doesn't lift at all). His girlfriend of 4 years is a bombshell asian chick (same height as him), easily an HB9, turning heads as she walks past. She gives no ****s about his height, probably because he has an absolutely magnetic, charismatic personality. He's ambitious, has great career prospects, etc. Whatever he lacks physically (though honestly he looks just fine, and dresses really well), he makes up in other aspects of himself. He's ambitious and driven towards his passions and personal goals, and women are addicted to those kinds of men.
My old oneitis who brought me to this forum was another; I'm 5'4, and shes 5'2. I never ever got the feeling that my height was even relevant to her (even though in my observation, she certainly appreciated tall muscular men as well). For the period of time when we were intimate, she'd even sometimes stand on my toes so that our faces would be at the same height, though we were essentially the same height anyway. Damn, that made me feel manly haha.
And this is another thing - quality women will (and know how to) make you feel manly/masculine, regardless of your physical imperfections, not belittle you for them (though you should always expect a little teasing). There was an RSD tyler video in which he said that whenever a woman **** tests or teases you about your height, race, etc., what she's really saying is: "Hey I think you're interesting. I'm ok with your imperfections, but I'm wondering if YOU'RE ok with them." Or at least that's how you should frame it in your mind.
Really look at and observe these examples of short men (both on this forum and in your day-to-day life) who have attracted quality women, and those attractive women who are happily dating short men - let them serve as an example/inspiration/hope for you, don't just throw your dating life away if you're short. As an aside, it seems to me women who are willing to look past such things as height and date short men are more likely to be quality women (not that women dating taller guys aren't or can't be quality girls; it's simply that the act of dating shorter guys is already strong evidence of the mentality of being more open-minded, etc.).