Is it possible to add an IF conditional like:
IF request response status is not 200 (OK), then don’t increment request counter, but still add it to the request logs with its failed status.
A ‘request info indicator’ might be helpful in the UI too with info like:
- Model used
- Response status
- Response duration (so you can see from your end when things are slower than usual)
- Request token count
- Total chat token count (feature request)
It might help to avoid this ‘silently failing’ dynamic.