Hey, sometimes the latency can be higher if the demand for Tab is high, but we’re working to improve the capacity so this doesn’t happen in the future.
Hi, since the Tab Autocompletion is very latency sensitive for the developers, I am wondering whether we have some location specific servers for this tab autocompletion, for example in the Japan for the Asia developers?
Actually, I don’t have a very precise way to measure it.
When I check the logs, I often observe that the “streamingtime” frequently exceeds 1000, and in better cases, it’s around 500; the “actualTtftFromStart” values range between 300-600.
From practical usage, it’s acceptable for some time, but sometimes the wait time for code suggestions can be noticeable. The latency performance is not stable. Additionally, when I previously used SuperMaven, I felt its response time was excellent, with code suggestions appearing almost immediately after typing characters.
I know my description might not be accurate since I don’t have a scientific measurement method - it’s just based on my user experience. What I expect is that I shouldn’t need to pause during programming to wait for suggestions.
Again I am a big fan for the tab autocompletion. I don’t care about the model in agent or composer, but I can’t live without the tab autocompletion.
Even more, I can pay more for a very stable or dedicated auto completion functionality.