Haven't found the article of law either, but a reliable source - Ktipp

There is no "Ausweispflicht" (obligation to carry identification), BUT police have to right to stop and detain you until such a point that your identity can be confirmed.

You don't have to carry it, but it makes life so much easier in case you need it...

Edit: Also found the EF article through google here