Hive issue

I am having major issues with my second hive moving up into the honey supers. I did a quick check last week and both lower are full of broad and honey. I tried removing the queen extruder for a week, sugar water and even put a box on top that I extracted honey for them to clean up from another hive. Nothing works and all they did was clean the frames but not stay up.... Last Friday a small group finally swarmed out of the hive and settled in a tree about 60 ft away but 20 ft up. The swarm is only the size of a baseball and they have stayed in the tree for a week now and not moved on... They are too high up for me to safely get so I was going to let them just go because it's small swarm... The other wierd thing is about 4-5 times a day they take off and fly around for 5-10 minutes but return to the branch... Is this normal??? I also put up swarm trap near but they are showing no interest in it.... Thoughts or ideas??