I strongly relate to this. I work a professional job with a flexible schedule, from home, and my wife takes care of our daughter and our home.
Because we control our costs, we are more financially secure and enjoy more leisure than many of our relatives who either have two incomes or one high earner in a stressful 9-to-5.
It really does come down to time-preference. There are many things that we know we would enjoy (and eventually will enjoy) that we don't spend money on now, because we have enough for now.