Funny thing - I’m one of the exceptions, mainly due to making lemonade, lemon meringue pie, limoncello, etc. out of my ‘life handed me lemons’ circumstances.
I’m autistic, some of the symptoms for me was the inability to read non-verbal communication and create small talk. Hence I didn’t really ever date successfully. Only ended up married (at 47) thanks to some friends that set us up. So all that money I would have spent on raising children - I didn’t.
I didn’t get my engineering degree until my early 30’s and lived in poverty until then. Hence, I was so used to living minimally, that I continued to do so, even as my income increased - a lot. I saved all that extra money and invested a lot of it. I retired from full time work at 56, but continue part time in my current gig. I don’t really need the money, but the work is fun, challenging, and I hang out with a LOT of really smart engineers (MIT PhDs, etc.). Not bad for a guy with a BSEE at a no-name university.
I was also fortunate for many years by being around people that recognized the strengths of my autism and let me solve really complex healthcare technology problems on a large scale. I feel I was born to do it.