Just leave them be, they kill other nastys you wouldnt want around. All part of a healthy ecosystem.Get an old jam jar, hammer some holes in the lid big enough for wasps to crawl through then half fill the jar with honey or somthing similar.
Works a treat.