Goldtop, I think that if you are not a permit holder you are given a choice. I spoke to the Office d'impot and was told about a simplified procedure. If you do not want to do it this way you can be taxed according to the normal procedure.
In their opinion if you just hold a holiday home it is cheaper to pay tax by the simplified procedure