capped brood is normally light brown to dark brown depending upon what it's age is. Honey on the other hand is normally capped with white wax. You should see white larvas and small eggs if you look closely into the cells. If you find the eggs your queen is in there. Don't worry too much..