Hell, people will bitch even when the service is free. I had a bunch of assholes that I have Patreon page for my youtube channel, they were complaining about "how you DARE to ask money for making such shitty videos". I still hesitant with promoting my own Patreon page at all, because I launched it only because Patreon was increasing their fees for all new pages that were going to launch later. All I was doing for my patrons is mention them at the end of my videos and monthly updates with a sneak peek for my next videos, and even that somehow triggered some people.
Ignore them. You make content and it is free on Youtube.
I am a big supporter for creators going to Patreon. but anyone who thinks they can support their work with Patreon only content (so no free release after a specific time) is kidding themselves. Most Authors, developers, modders, artists, who didn't release free content anymore lost most of their audience or never took off in the first place.
Bonus Patreon-only content? mostly fine, as long as normal free content isn't impacted
Patreon Discord only? Fine.
Patreon-only multiplayer sessions? Fine
Patreon-only polls? Fine.
Patreon-only early access (the most common thing on Patreon) fine.
But ditching your whole audience? death-knell
For modding especially: This is not sustainable. Should I pay 5 dollars for every one of the 100 mods I use? What if your mod is part of a compilation and only works / makes sense with other mods? why does your mod gets paid and the others not?