One way I look at this is. It is more about becoming aware of the mental dispositions that cause us suffering, and when we become less ignorant of these and wise up to them, we naturally let go of them.
The good stuff remains though. It is okay to have a good life, to be comfortable and have some fun. This practise does not have to be a morose and sombre experience. After all it is the way that leads to the end of suffering. Enjoy the pleasant moments, as fully as you can, but practise wise attention to them. Notice how the mind clings and thirsts for more, and how this makes us suffer. How the things we are attached to the most, are the things that cause us to suffer the most when we become separated from them.
Mindfulness, wonder, interest, investigation, energy, joy, peace, friendliness, love, kindness, good humour, generosity, empathy, connection, compassion, serenity, samhadi, and equanimity to mention some, are all beautiful states of mind that don't cause us or anyone else any harm. These states of mind are good for us mentally and physically. They also bring good kamma, because they reinforce the mental dispositions that lead to good states of becoming, that lead away from suffering. They make us happier, healthier beings, and enrich our lives and those around us.
It is like someone who has been sick with an illness, with a fever, becomes unconscious. A doctor comes along and examines the patient, knows what it is that is wrong with the patient and how to cure them. He gives the patient some medicine. Their consciousness returns, then the colour returns to their cheeks, they sit up feeling much better, then their composure becomes serene and radiant. Feeling the relief of no longer being sick.
In a similar way, when our minds are clear of greed, hate, conceit and delusion, they become well again.
It isn't the world outside that is the problem. It is the greed, hate, and delusion within us that is the problem. That is what causes us suffering. That is what gets in the way.