If there is a laying worker, no you can't just shake the bees off in front of the hive, they will all just walk back in and continue as before. You will want to shake all bees off all combs about 100 yards away. Foragers will return home to a new caged queen and the laying worker or workers should now be lost. You shouldn't have to worry about loosing nurse bees, as there shouldn't be many if any at all given the queenless and broodless period to develop a laying worker scenario.