You’re right. No writer can please everyone.
We don’t write for everyone, either. if we did, our work would be so watered down, it would have no flavor.
Press on, and make a difference for the readers you choose to serve. The ones who matter will love you for it.