So when you are in a dungeon, you may have to wait a while for your thralls to catch up so you can jump the enemies in the next room.
Pressing the wait button and waiting for an hour or two usually puts them back with you.