The safest insecticides that can be use abating the population of the defoliators in garden is Sevin. There are other brands that can be use like Lannate but is not as safe as Sevin. However, if the population of the insect is not that big that you cannot handle, you can still try to manually remove them with your hands.

You can buy Sevin in any agricultural supply store.