Bees like to build down and move up. Swapping boxes is nearly a must. although when things get tight they will use the bottom box. The hive will build much quicker, and maintain a more productive season if you swap. it is also much easier to determine the proper time to add a super.