One way I look at this is. It is more about becoming aware of the mental dispositions that cause us suffering, and when we become less ignorant of these and wise up to them, we naturally let go of them.
The good stuff remains though. It is okay to have a good life, to be comfortable and have some fun. This practise does not have to be a morose and sombre experience. After all it is the way that leads to the end of suffering. Enjoy the pleasant moments, as fully as you can, but practise wise attention to them. Notice how the mind clings and thirsts for more, and how this makes us suffer. How the things we are attached to the most, are the things that cause us to suffer the most when we become separated from them.
All conditioned phenomena is transient and uncertain. If one's happiness is dependent on conditions, it is bound to disappoint. As those conditions are outside of one's control, they will change and then that happiness will end. That is why it is precarious to place one's hopes in worldly happiness. It is not wrong to enjoy this happiness. It is just, material things are not the real treasure in life. The pearl of great worth comes from within. That's what we reach for at death, what we take with us when we die. Everything else is torn away from us.
Mindfulness, wonder, interest, investigation, energy, joy, peace, friendliness, love, kindness, good humour, generosity, empathy, connection, compassion, serenity, samhadi, and equanimity to mention some, are all beautiful states of mind that don't cause us or anyone else any harm. These states of mind are good for us mentally and physically. They also bring good kamma, because they reinforce the mental dispositions that lead to good states of becoming, that lead away from suffering. They make us happier, healthier beings, and enrich our lives and those around us.
All the beauty of the heart remains, and shines the more brightly without the clouds of greed, hate, conceit and delusion.
It is like someone who has been sick with an illness, with a fever, becomes unconscious. A doctor comes along and examines the patient, knows what it is that is wrong with the patient and how to cure them. He gives the patient some medicine. Their consciousness returns, then the colour returns to their cheeks, they sit up feeling much better, then their composure becomes serene and radiant. Feeling the relief of no longer being sick.
In a similar way, when our minds are clear of greed, hate, conceit and delusion, they become well again.
It isn't the world outside that is the problem. It is the greed, hate, and delusion within us that is the problem. That is what causes us suffering. That is what gets in the way.