I haven't tried it myself yet but that's what the plans on this sight suggest. http://www.beesource.com/build-it-yourself/miller-type-feeder/
As long as its spar urethane or marine varnish it should work. They also suggest to pour molten wax into all inside seams (after finishing I assume).
Polyurethane is none toxic when cured.
A forum community dedicated to beekeeping, bee owners and enthusiasts. Come join the discussion about breeding, honey production, health, behavior, hives, housing, adopting, care, classifieds, and more!