I took a quick look at the chat, and when the limit is reached in the Thinking window, a message appears indicating rate limiting at the model provider. This confirms exactly what is described here: an external model provider is being used, and a limit is then reached.
This occurs during the LLM’s internal reasoning process. I therefore strongly assume that, beyond a certain size, these limits are reached, regardless of how this is currently implemented—via a streaming service or otherwise. This is a fundamental architectural issue.
For example, it means that handoff reports cannot be created. Hypothetically, if there is a 15,000-line handoff report that needs to be summarized because certain tasks have already been completed, and the resulting summarized handoff report would be 6,000 lines, Kimi simply cannot process it because of the rate limits.
This is extremely limiting.
Also, even when a system rule is used to create individual batches, limits keep arising in the internal reasoning process because it is expected to consider in advance how the entire full response will be packaged together.
This means we need to use prompting techniques and workarounds to ensure that all topics are created on a chunk-by-chunk basis, rather than overloading the internal reasoning process through rate limiting. From a prompting architecture perspective, this is, of course, extremely suboptimal, with potentially significant downstream consequences for the handoff reports generated as a result.
This means we need to use prompting techniques to implement append logic, so that only segments are created. Architecturally, we must prevent the model from building the complete full response in its internal reasoning process first and only then creating the batches or chunks.
Instead, we need to ensure that each individual segment is created first, then re-anchored, and then reconsidered. Of course, this is incredibly suboptimal.
I would greatly appreciate it if more effort could be invested in this topic. Kimi is currently one of the best models, and it is extremely limiting that this does not work.
For several years now, I have continuously opened posts here about various limitations related to MCP topics, including issues where content is written to text files, which still have not been resolved, or still no support for custom system prompts, as well as many other issues.
I would truly appreciate it if this topic could be addressed with a higher priority than the other items that are still open.