I try to harvest pollen from my traps daily or at least every other day to avoid what you have described. The small larvae are probably from SHB. Even though you are not seeing the adult beetles, they've been there. After harvest the pollen goes directly into the freezer which will kill anything that can damage it. I clean it right before packaging.