Make sure that when we modify a rate quota, we stop the existing goroutine before starting the new one.
Nick Cabatoff