Your book, whatever it is, isn't going to be for everyone. And you don't need to try and make it for everyone. There's going to be a set of people (I don't know how large a number) that just won't ever be interested in what you're writing - and that doesn't even have anything to do with you.

They won't like it because of the genre or the cover or the title or any number of other reasons that have nothing to do with who you are as a person or author and nothing to do with what you've written.

These are people you don't have to try and persuade to read your book. They're not your people. Your people are out there, and they're going to like your book (and you) for what you provide. Focus on them.