could do both or they could stay there. last year i caught a swarm and couldn't get all the stragglers. i told the homeowner that they'd leave eventually. a week later i went back and got the majority of them. best if you can leave the box until dusk/dark and then collect it in hopes that the stragglers will eventually join the rest of the swarm.