I have been told that I don't seem to be in a STEM field, which I would take as being relatively charismatic. But "charisma" alone is not enough.
It typically would not be enough at your height. Sometimes, there are outlier guys. Neil Strauss is a common example of a shorter guy (5'6") who turned himself into a master seducer by spending time with Mystery and other PUAs. Strauss is considered an outlier in the seduction community for his outcomes.
I am aware of other men with good seduction outcomes with below average heights. I consider those men to be outliers.
I've seen women treat me like dog poop for my average height. I can't imagine what it is like for the shorter than average men.
I've developed the skill of talking to women from the position of hunger - having ZERO social circle in all-male middle/high school, and then a STEM program that should be called Sausage Engineering, and a career that was just as much sausage has meant I've had to earn every morsel of poon the hard way.
Besides height, you were dealt a bad hand.
I didn't realize that you were all male in both middle and high school. I thought it was just high school. I've interacted with males who attended all male schools for high schools. It takes a lot to be successful in mating if your high school is all male. At a minimum, a guy in an all male high school needs to be above average looking + have a good social circle from when he went to co-ed schools in K-8. Without both those factors, dating is going to be VERY difficult in high school for him and that can have a long term impact. I think your social circle from elementary school was weak when you entered the all male school + the height issue. That's a recipe for disaster.
Going from an all male school into a STEM major in a co-ed college isn't going to help. Few girls in classes. You would have had to be very involved in campus clubs where females were present, be in a good fraternity, or know where the good off campus parties were with females. That's not easy.
You have had to earn poon the hard way. Doing that for 40+ years stinks.
I learned early on that it's always the fat chicks that folks are always trying to pawn off on me - as the decent chicks never seem to be "looking for someone" enough for them to have friends try and set them up, at least with me.
I have seen some social circle setups where the woman wasn't fat.
I've rarely received introductions. There was a time when a female I know texted me about a setup. I found out in texting that the woman was fat and slightly older than me, both of which are dealbreakers for me. I refused the setup and indicated my lack of interest. It's good that you refused fat female setups too.
It is offensive to receive fat female setup offers.