I often wish I had a cross bike too - There are so many great places to ride around here that turn into gravel roads. Some of the best mountain passes seem to be that way.
When we did
Stelvio Pass last summer our friends had made a sort of cross bike by putting slicks on a
hardtail - Even though there was no gravel on the side we did, they were much more comfortable on the looong and winding descent (not to mention they had mtb gears on the ascent!). And the next day we did the approach from the Swiss side where there was some gravel, so their cross bikes would have been better there too.
Of course it depends on what kinds of rides you plan on doing -- Do you want to race or hang on with packs of roadies (if so then the racer bike is the way to go), or climb mountain passes on your own or in a small group (then you may want to consider a cross bike)... or even do some of the Swiss national routes - since as this
thread says, they have lots of gravel/trails too.
So there's some more to chew on!