I'd say if you renounce your residency and then go do it, you might get away with it.

I certainly know at least one person who tried what you're suggesting with a motorbike licence and now still has to pass the Swiss test.