As I see it, assuming a no-deal Brexit, your only problem is likely to be on the UK side of the tunnel on your return.

Here, the French customs are likely to be checking. But a Swiss car with your Ausweis handy will hopefully be no problem. Once you on the shuttle you are in Schengen and there should be no trouble the rest of the way...