I've had good luck spraying bees with Sevin. Use a pump up sprayer and stand way back. Soak the area real good. You might have to repeat the process, but eventually, if you kill enough bees, the colony will collapse. Same principle used with ant poison. Kill enough workers and things fall apart.

You may also be able to find a pheromone trap for them. They are available for some bugs, not for others.

Steve