I've used potted plants and such in front of entrances...never sheets of plywood. Can the returning bees see their landing boards/hives at the new location??? Keep your kids/animals away from the old location. Bees that can't find their home are NOT nice.