Is Insecticidal Soap Safe to Use for Aphids on Herbs?

I have been growing, only for a few weeks, some herbs on my kitchen window sill. I have basil, cilantro, mint, and rosemary. I just noticed aphids on the stems of the cilantro and under the leaves on the basil and mint. I've read answers to other questions on ridding aphids, but I was wondering, the soap solutions that are often recommended, are they okay to spray on plants that I will be eating? Is there any pest control solution that is safe for human consumption?

Insecticidal soap is perfectly safe to use on edible plants such as culinary herbs. The soap used is essentially the same has handsoap except that potassium is used instead of sodium.