Rich, having a few stragglers probably isn't a big deal. if you pull half and then remove the board to grow the other half up, they will work it out. If you reuse it for mating, same thing.
jw, any idea on how common it is to have the bees glue the follower board down to make it really hard to remove. I hadn't thought of that.