The areas should be sprayed liberally with the wasp spray. The wasp will die on contact. This is a good thing. If you spray them with water or attempt to knock the nest down, you will make them angry.
Let's Get It Fixed!
HomeX virtual experts will assess your issue (for free!) and can resolve simple problems.