How about insulation on the box itself?
Do you build them with thicker lumber or insulated panels?

I suppose with insulated follower boards the need to insulate the narrow sides is reduced, but...