That's awkward. I would probably loudly say pointed things to my child to make it clear they were our trains, so it didn't look like we were stealing them when we left.

Then I would avoid going back to avoid further awkwardness.

Parenting etiquette is a minefield.