I host oss-120b through a website of mine, and I wanted to try out cursor for the agent coding built in, but I was disappointed to find that I can’t run local models on a free account?
I set everything up with overriding the OpenAI BaseURL, not using anything localhost since it’s hosted through my domain. The api key is also set to something valid for my server. Nothing I tried worked.
That is, until I signed up for the 7 day pro trial, and now chat requests to my local model worked without me changing a thing! It still didn’t let me try the agent mode since I wasn’t a paid pro account, but this was enough to bring me here.
Swapped accounts to a new free account, didn’t change any url or api settings, and now chat is broken again.
Is it just SOP here to charge $20/month for the ability to run local models through Cursor? I can understand why they charge for access to their server’s models, but I don’t see why I need to pay for my local model to work.
Opinions aside, I haven’t seen any clear documentation on this after a bit of searching around, so I hoped I could get a clear answer here. Thanks!