How does Cursor use ChatGPT for so cheap?

We use OpenAI’s reserved capacity option. This gives us a set of dedicated servers that only go to Cursor traffic which 1) drastically improves the caching behavior of our prompts 2) means tokens don’t mean much to us for pricing, just the time it takes to process a request and 3) effectively gives a volume discount.

2 Likes