Starise, I prefer to see a wasp in that state.
In my line of work, I come into contact with way too many of them. As a cable tech, I am always working under eaves and opening outdoor enclosures, prime spots for the little buggers. And they are not friendly.
I carry a few cans of wasp spray as well as my MAPP torch for fire ants and black widow spiders.
As for getting rid of that nest, yes, they are relatively sluggish when it is cool. However, they have a nasty disposition, and don't like being messed with. The warmer it is, the faster you have to run.
If you have the option, attack at dawn, rather than evening. They haven't warmed up yet, and are far less responsive.
Good luck.