Here is a photo of paper wasps over-wintering in a dead out. These are the source of bee predation later in the year. Each one that you see develops her own paper nest. They did not last long when they were introduced to my hive tool1.
Paper wasps are often mistakenly called yellowjackets by the non-entomologist. These wasps are much longer in body and have a very thin "wasp-like" waist. They make nests under the eaves of houses, in bushes, in empty boxes and garden pots, etc. These nests are relatively small, consist of only one layer of comb for brood rearing and are never covered with a paper envelope (that is, when you look at the nest, you can see the wasps and the comb; yellowjacket nests are covered with a paper envelope). Paper wasp nests only reach a colony size of about 100 wasps. Paper wasps are brown and yellow whereas yellowjackets are usually black and yellow.