If you can get an experienced eye to help inspect for the queen, invite him / her over for lunch and an inspection. If she is still there after you've split them, you'll want to get those queen cells out ASAP, or you will lose ~half of one hive. If the queen cells were capped before you found them, she's probably already gone - that is about the time they stop feeding her, chase here around the hive to get her in shape for swarm flight, then take off 2 days later.
Queens are not easy to spot until you've gotten you eyes / mind adjusted, but she's usually on the open brood, if more than one frame, usually the one with the newest eggs. Upright eggs are brand new today, leaning eggs are yesterday's, parallel eggs are about to turn into grub worms (larvae). The newest frame usually has the most developed larvae / eggs in the middle, "tapering" out to brand new upright eggs outside the center of the pattern. The older frame will likely be more grubs than eggs, especially larger larvae will be present.
Queens can be spotted by their large abdomen, their often bald and slightly larger thorax, their wide-set eyes, their behavior (the big abdomen goes down in the hexagon cell, worker bees go in head-first, and by bee pattern - the attendant workers are often in an oval around her. You'll get the picture eventually by not looking at individual bees, but by picking up activity that indicates a queen and then, zoom! you eyes pick her long, often monochrome translucent brown abdomen, although sometimes you'll find her black, bright gold, or striped yellow and black.
In the mean time, while you are learning to spot her, read up on the 50 morphological differences between a queen and a worker, and think about here jobs as momma, egg-layer, communication boss, cell inspector, director of attendants. You'll probably get the hand of it a lot faster that way.
