Paper bags might not be in a typical office supply place.

They are more likely to be found in a wholesaler that deals with small businesses - office world is more of a direct to consumer operation, if that makes any sense at all.

HAve you looked up this german term?
Papiertragetaschen

Maybe this?
http://www.tragetaschen-discount.de/