If you don’t have regular bug spray around, Try Formula 409 (the household cleaner).  Spray the Formula 409 on bees, wasps, etc., and they will drop to the ground instantly.  If they don’t die, at least it makes it easier to swat them without fear of retaliation.