I always took my daughter with me wherever I went. I went plenty of places. It was never an issue.
Then again, I never had people acting like self-righteous tossers telling me how to deal with her either. Nor did anyone throw a toddler tantrum over me leaving early if I had to.