I have volunteered a few times with the Lausanne Voluntaires Sportifs http://www.volontaireslausannois.ch/html/index.php You will see their tent at most sport events in town.
Once you join, they will email you when they are looking for Volunteers for the different sporting events in town. Some examples that I have done are: giving out dossards for the Cyclotour, cleaning up the VIP tent after Athletissima and serving (non-alcoholic) drinks to soccer fans at a UEFA game (that was tough!). Normally you get some freebies and to see the event. It will take years to be able to get the good jobs, but its still fun and rewarding.
I always advise that my French is limited - but you survive and its a good learning experience, not just for the French.