Generation speed randomly spikes from 1s to 3s per line

I'm generating a 40-chapter narration and the timing is all over the place. Most lines render in about a second — then suddenly each one crawls at three seconds. Nothing changes on my end when it slows down. Same text length, same concurrency, same everything.