I don’t see any good reason why this should not be doable, or made doable.
Any RAG or prompt optimization can be made client-side and the cache either made local or cut entirely.
We should be able to use this on international flights, which is not possible right now.