Hi @droslean Understood and I appreciate the gravity of the situation and your concern. It is normal behavior in the sense that models are probabilistic and not deterministic so their behavior varies slightly each time. However, there are some things I can help you with to improve and get better results that align more with your expectations.
Can you tell me a little bit more about the scenario, especially the following details would be great:
- Which model are you using?
- How full is the context window? Has it ever been compacted or summarized?
- Which turn in the conversation is it? E.g. did it happen on the first response or after 30 back and forth messages with the agent?
- Approx how big is the repo? (100k files, 1k files, etc.)
Cheers