Let's face it, if your baby (or dog for AbFab) cannot "behave" in public then you might think twice about visiting a restaurant.

Given that's usually the minority, go ahead.

I'd say the comment is from someone with a considerably smaller social circle than you. Service is about the customer - most places would not create a fuss.

I'd get over my trip to the place and the comment quite easily btw