Consciousness is just as indifferent to your existence, your well-being, as matter, or perhaps is more so. I adds insult to injury by denying that you have any existence as such. Or say that matter is just the conservative aspect f consciousness, the part that wants to be defined and stay defined once and for all - its gravity, its futile desire for perfect repetition, its effort to escape itself.