Just be done with it an tick the "no" box.

There's no rule which states you must worship in a church, this is just you buying into a culture of you propping up an already corrupt system. Admittedly some churches do a lot of good for the community other well...I guess you know.

Burn the lot to the ground and start again. Give the rights for those to choose to worship as they will back to the people.

Traditionally this was a position of power where the church controlled who had access to religion and who didn't, who was a sinner and who wasn't. We moved on 400 odd years and so should the church. Seems this pattern is repeating itself with the current religious nutcases in the ME + Southern US.

Where's the "Contribute to benzine + ritual burning at the stake" tickbox?

Parts of the church tax is affected to renovating, restoring, and maintaining the churches. To me that is very important as Switzerland has some gorgeous churches we can all enjoy and visit.
Also as Odile said so eloquently, people that do not pay the church tax are suddenly surprised to not benefit from the services that are offered by the church especially during difficult periods.
Finally, some say that they are used to a separation of church and state. Well, it is not the case here but it doesn't make it wrong. A lot of it is historical.
There was a federal referendum in 1980 to get rid of the current church tax system. It was easily defeated. So be it.

There are plenty of so-called free churches where people have done precisely that.

Now who's four hundred years out of date.