OK, back on topic:
There was a place in Geneva that had an oyster/caviar bar and it was full all the time. Also, many people I knew in Geneva had caviar & salmon (not together) blinis and oysters for New Year. So I would say that yes some Swiss do eat caviar. Now will your neighbors? Had to say.
I'd start with a small plate and have a second option. And see how it goes. If the first plate goes off like wild fires then bring more. If not, bring out plan B.
We love caviar (hint, hint).