In Composer, I often encounter issues where files return a response but fail to apply. Reapplying usually doesn’t fix the problem. This happens most frequently with Omni models, especially when using large context or making large or multiple updates.
Sometimes I see rate limit warnings at the same time. It’s frustrating because I end up paying but can’t actually change my code. I suspect this might be partly because the response isn’t streamed, and also because too much data is being returned.
This situation is really annoying because I don’t want to underuse or overpay for these models. I definitely don’t want to pay for updates that fail. I’m trying to find the right balance of using the models effectively without wasting money on failed updates.
Version: 0.41.2 (Mac)