I agree with you in principle. Doing it is a challenge. If you have a family (wife, couple of kids, dogs, aging parents, etc. etc.) the expenses can be enormous and somewhat unpredictable. Think housing costs, college, health issues, cars for the kids, food, utilities, family vacations, etc. etc. etc. The list is endless. Then add "fun" things such as nice cars, boats, vacation homes, etc, etc. Of course these "material items" are not necessary, but ...... the memories with these "material items" are priceless. Memories I spent with my children and wife. I would not trade these "life" experiences for anything.
Now. The key is to have balance. Balance in investing for the future and living a fullfilling life in the present. No one wants to be broke during retirement. But I also want to enjoy my golden years while I still can. No one can predict your eventual demise.
The old saying is you don't want to be the richest guy in the cemetary.