If you have limited entrances, and only one hive, I think it's very unlikely that it's being robbed. When robbing occurs, you often see some bees fighting at the entrances, but after a while, they give up and it just looks like a ton of activity. Robbers won't usually have pollen on their legs, but there can be foraging going on during robbing, so the presence of pollen on some of the bees won't rule it out.
I suspect you are seeing orienting flights from some of the newly emerged bees. They'll spend an hour or so mostly flying back and forth in front of the hive to learn the area for when they go out foraging. Robbing also involves bees flying around in front of the hive, but the bees generally focus more on getting in and getting out, rather than zipping around happily learning landmarks.
If you suspect robbing is happening, close down the entrances to make the hive easier to guard. This may cause a traffic jam, but it won't really harm bees trying to make their orientation flights.