Its pollen. they will keep it close to the brood so that they can feed the larvae. I have seen it in a myriad of colors....you are OK. When checking your hive, stop looking for the queen and look for eggs in the dead center of the cells. You may have to turn it toward the sun to see. If you are seeing eggs, her heiness is in there somewhere or has been within the last couple of days. I know how you feel, just watch and let the bees teach you. I missed a pretty queen the other day because her butt was in the cells more than it was out...which is a great problem to have at this point!!!