It's not selfish to rest. You're not a bad person for thinking bad of others. And it's not your responsibility to keep others happy.
My Father 68y/o, My Mother 64y/o, Me 24y/o