There's a lot of truth in this statement and that's because you don't offer what the market of 22-32 year old women want in an extended relationships.
The "why" matters to an extent but you refuse to fix the problems associated with your mindset and behaviors that would make you more attractive to women near your own age.
45-54 year old women see you as an age inappropriate prospect. Almost none would take you seriously as a longer term prospect due to your age. Almost none would even want a first date with you. 45-54 year old women generally want to date men near their own age. Your neighbor in your building is a perfect example of this.
While there are likely some 45-54 year olds who could find you physically attractive, it wouldn't mean much in general.
If you were to ask out 45-54 year olds in person, they would also find it strange that you are asking them out. They too would not like your behavior, but mostly because they see your behavior as odd for pursuing an age inappropriate interaction.
I've mentioned before on here that I lust after my next door neighbor who's nearly 20 years older than me (she's in her early 50s) A few months ago, we got a new female employee in our building (the new girl is in her mid 20s). Shortly after the new girl started, my next door neighbor was...
www.sosuave.net
Most 22-32 year old women aren't ruling you out on age alone. Some 22-25 year olds might, but not 26-32 year olds.
For the 22-32 year olds, you are mainly being ruled out on behaviors. Some would rule you out on a combination of age and behaviors.
22-32 year olds are often looking for someone with future husband and/or future father capabilities. Those goals might be a long way off for some, but they often would like to envision that as a reality. A strangely behaving guy isn't going to make a good husband for them and won't be able to get them hot & horny for you in the pre-husband stage.
45-54 year olds usually have a failed marriage in their pasts and are done having children. They don't care that much about you as father potential, though some of your awkward behaviors might turn them off. They might not want to have their teenage - 20 something children near you due to the awkwardness. It's possible that the few who wouldn't rule you out due to age might keep you as a short term fling if they really thought you were somewhat attractive and they realized that they couldn't get a Chad Thundercock. That's a very low probability effort.
If you were to fix your mindset and behaviors, you would be more marketable to a large percentage of women.