Height matters.
99% of the time, your average 5'6 female is going to prefer a 6'4 guy over a 5'4, all else being equal. The same way your average 5'10 male would generally prefer a 5'4 female over a 6'4 female, all else being equal.
Women like to feel small and feminine, whereas guys like to feel dominant and masculine. It's just how we're wired.
That being said, your height is not an excuse for not getting laid. It is not an excuse for failing to find a girl worth her salt. It is not an excuse for lack of success in any aspect of your life. Does it factor in how a girl perceives you? Yes. Is it a deal breaker? For some girls, yes. But guess what, any girl who filters you out solely because of your height is doing you a favor. Just like if you are bald or are going bald and a girl filters you out because you don't have a full head of hair, she is doing you a favor. Just remember that.
I'm 5'9.5 and the girl I am currently seeing was in two previously long-term relationships where both guys were 6'4. Height isn't always a deal breaker, but it does influence the perceptions and decisions of others. No sense being ignorant of it just because it makes you feel better.
Your height matters... But your reaction to your height (how you carry and perceive yourself) matters more than the actual number on the tape measure.