From everything I have seen and heard from you, and I think I may have offered this advice some time back, but I really think it comes down to a few things:
1. Lack of social confidence
2. Lack of empathy
3. A specific type of narcissism
I do not mean any of this in an insulting way. I'm specifically outlining this to give you ideas for a path forward.
I apologize for replying so late to this, I've been spending a lot of time thinking about what you mentioned here and wanted to really reflect upon it before responding.
I agree with much of what you posted on here, which is something we have discussed, and I do feel that those are the root causes of this, which were also further deepened by experiences during my teens through well into my 20s. I truly believe that I am a very unique individual and that nothing about my life is all that "normal" or run of the mill, and there are tons of other very extreme things that I've experienced that I've not mentioned on here. I know that a lot of people may say this about themselves but I deep down do feel this way. I personally feel that some of this is part of the reason why I have such a hard time relating to people on a deeper level. However, I also have long had the feeling that most other people can't relate at all to me in any manner or fashion, so it has created this repetitive cycle.
I'm going to get into some more specific things.
As I've pointed to on this thread, as well as countless other times on this forum, very few men are physically like me and that has often been a source of confusion/struggle for me, which I'll get into some examples.
A little over a year ago I had tried spending one on one time with a female who was by chance within my sphere of existence. She was very average, honestly I'd rate her a 4, but I went for it because it was there and she seemed nice and I found speaking to her lead to interesting conversations. It didn't line up in my favor, even responded by saying "ewww" but later that year she was in a relationship with a man who was pushing 300 pounds and literally didn't work and was broke. I wasn't even really that into her and only pushed for anything because it was an opportunity but her going for a man like that but putting me down was very confusing to me. In my mind the biggest issue was the fact that I'm being criticized but yet this woman is happily bringing in a person who is of a much lower level than I am. While there is a lot of truth in that statement, this is in fact a comping mechanism as you mentioned.
A little over a week ago I was at the gym and by chance I ran into this girl I had gone on a date with almost 3 years ago, I had met her on a night out with friends and had 1 date with her, which resulted in her ghosting me afterwards. Anyway, both recognized each other and she was with a guy, obviously her bf. The bf was very average and nothing like me physically. However, while I recognized that I started reflecting upon it and then considered the idea of what I've been behaving like to make these women turn away. I said "If she is going for a guy like that but turned me down there must be something that I need to be doing that is causing this and I don't know what it is". Which I'm going to get into below.
A repetitive internal thought that I'd experience was "I'm taller and in better shape than any man the vast majority of women have dated or slept with but yet I'm getting criticized by them?". As others have mentioned on here, I do strongly suspect that it is possible I'm around people, including women, that aren't on my level and knowing this they are behaving this way towards me out of insecurity.
@SW15 is familiar with the metro I live in and I've spent quite a bit of time trying to ascertain if this is possibly a part of the dilemma that I'm currently in, in that it may be harder for me to find people, including women, who are more on my level. However, as you've mentioned I don't feel that the current area I'm living in and the people that I seem to have come into my life are the only variables that are at play.
I do feel that much of my personal behavior and the interactions I'm having with the people around me have played a major influence in developing the social experiences I've been having. For instance, one of the issues I've posted about on here with the people in my area is that there are a lot of gold diggers, social climbers, etc. While this is most certainly true, as I can cite tons of examples of people that I've never been very personal with, there were certain things that I had been doing which caused this energy to pop into my life. One of the issues that I actually feel I may be guilty of is advertising a bit too much of myself. I don't use social media, but whenever I have success or have certain things going for me I think about it a lot and I feel that this is unintentionally coming out with the interactions I'm having. I think for some, especially those that may be a bit more insecure and not have as much going for them, it puts them off and makes them feel that I'm a braggart. For others though, I think they seek to be within my sphere so as to profit/benefit from me in some manner, more or less riding my coattails. I feel that while this may be partially my fault I also feel that I'm in a unique set of circumstances where I'm around people who aren't on the same page as me. This is why I'm trying to keep my successes on the down low but I've also strongly considered the possibility that relocating may be a good fit for me.
I will admit, last year my limited social life went to almost nothing. When COVID hit I used it as a reason to work as much as possible, and in my honest opinion this was the correct thing to do given the circumstances I and millions of others were in due to the closings. However, this developed into a habit that has gone well into this year and it wasn't until relatively recently that I actually spotted this and made an effort to reel it in. I've been making an effort to socialize more with people and have been going out of my comfort zone. For instance, last week I was supposed to meet up with a friend of mine and one of his friends. My friend didn't show but his friend, who I know but not close with, was there with someone I had never met. I actually felt this uncomfortable feeling right then and there, like I just wanted to leave, but I made myself work through it and spent the next 2-3 hours socializing with them. I didn't really have anything in common with that new guy I met, but I listened to the stories he was telling me and asked him questions. This is something that I have a hard time with and I feel is a good thing for me to work on.