It's inevitable that whatever you do, people will definitely have a say. Why not do what is right and please Allah because people's pleasure is never attainable.