Trading a bigger house with more comforts, more space, parking place and possibly a small garden only out of fear of not picking up women as easily?
Also we are talking about 20 minutes driving, its not going to live in a village, plus I guess you are in your late 20s or early 30s since you are planning to buy a house, if you were a teenage or early 20s I could consider that but right now no.
If you base your sex life out of tipsy one night stands sure it could be a problem but as an adult it shouldnt be, imagine having meetings in your garden cooking meat with someone bringing in his own guitar, then have some girl interested to see your room that same evening, wouldnt be easy as well?
In both the cases you have to put some work but in the case of your suburbs house you're in control much more than in a club or a pub.
Plus I guess at some point you either get a stable family or you simply quit on women (unless you can get 20yrs old girls while you are 50s as they said in a particular sosuave board...).