I know several guys much shorter than me that have a harem of women. One has a girlfriend and multiple **** girls. And because his gf is so hot and she allows him to play around, he has an unusual status. And that is next to me who is far taller and more fit than him. He made up for his disadvantage by focusing on other aspects of his life. He has good fashion, makes good money, and knows how to talk to people. He sets up parties and has a robust network. Now compare that to some average tall guy. The tall guy if he is fit enough may get the girls looking, but if he doesn't have the rest of the package, that is all he is. All looks, no substance.
Stop worrying about your height. The man makes the game, not the body. You wish you had the clientele that Harvey Weinstein had. And he was an ugly fat bastard.