Extreme fluctuations in Composer 2 performance

Hey, thanks for the report and the Request ID, I checked the session.

First, to clear up a myth: the Composer 2 model is not retrained every 5 hours. The checkpoint is static. Routing and infra can change sometimes, but the model itself is the same day to day.

What actually happened in your session:

  • A bug triggered where some non-English characters slipped through. This is an issue we were already tracking, looks like it regressed, I’ll pass it to the team.
  • The model returned an empty response a few times.
  • The session hit a usage limit, which could also affect the flow.
  • The conversation context was pretty large. In long sessions, quality drops a lot, it helps to split work into new chats.

So the feeling that the model was acting dumb in this case was not placebo, there were real issues. But it’s not a daily model drift, it’s specific session factors.

If it happens again, send the Request ID and I’ll take a look. There’s also a megathread for Composer 2 feedback if you want to add notes there: Share your experience with Composer 2!