Brood take some pretty tight conditions to succeed. A queen wants certain temperature and moisture ranges. So you may have a cluster that is too small to pull that off. if the cluster is that small, consider placing them in the smallest box you can find. Perhaps one of those dual queen Mating nucs. A small space would make it alot easier for the small colony to control the parameters to meet the needs.