The brood nest should stay only as big as the bees can handle. But - in warm weather this will be larger than in cold weather since fewer nurse bees are needed to keep it warm. If you get a cold snap (after laying up a larger area in warm weather) you can have "chilled brood" (death of brood because the bees contracted the are to keep the nest warm but had to allow some area cool down).