Maybe they swarmed out but the queen didn't. I know this sounds silly but is very possible. The bees get all excited about a swarm and bail out. But then realize they have no queen and head back to what they know. I hope you made a split to try and prevent swarming because it seems inevitable at this point.