Having been in a similar situation and did nothing. My hive developed a laying worker and ultimately DID get robbed out and I eventually combined with my stronger hive.

My advice is push it down...