I think we can use Gemini’s super long context ability and its caching to make it work like middleware. This could be used to send commands to other models or even do the job itself.
The latest Gemini model is quite good. I’m sure a lot of people would be willing to pay for API costs in order to get better qol"