What kind of bees do you have? Carni's and Russians are known to back off of laying toward the end of the season and even earlier if there is a dearth. Are you certain they don't have queens? With both hives full of honey, and many beeks reporting that queens have stopped laying, I wouldn't be too quick to declare them queenless. Harvest a full deep from both, and replace with empties and see if anything changes. If in fact they are queenless, I would certainly get new laying queens in them, since they have proven to be quite successful colonies.
There has been many, including myself, that have lost several queens during the past few years, and have struggled to get new queens created from remaining stock and mated late in the year. Mated queens are also harder to come by late in the year. So your situation, isn't necessarily uncommon. For this reason, my brother and I have began making queens and have resolved to always have some spare's on hand. So we now keep nuc's on hand to be able to react more quickly to missing queens, with less impact to the strong colonies. I've noticed that Michael Bush and others are doing similar practices. Check on his web site, as I believe that he goes into some pretty good detail on this practice, to ensure sustainable operations. I'd be surprised if he doesn't comment for you directly here.