I think it's fine to ask someone if they'd mind swapping seats, but absolutely not for them to just plonk themselves down without checking. I would 100% say no to someone retrospectively asking my permission on principle.