Since Transformers are parallel, why do we have to wait for AI responses?

You type a question into the chat screen and hit the send button. Sometimes the reply starts immediately, but other times ...