I don't get the complaint about people "praying you wouldn't be seated near them" then. Sure don't be a dick about it, but there's nothing wrong with simply not wanting to sit with children, as you said yourself.