Deepinfra support

Feature Requests
1

I would like to just be able to put the deepinfa api url and api key and have it just work

for example the deepinfra site give this

   -H "Content-Type: application/json" \
   -H "Authorization: Bearer $(deepctl auth token)" \
   -d '{
     "input": "[INST] Just say hi! [/INST] "
   }'```

and I would like to be able to put this url

https://api.deepinfra.com/v1/inference/cognitivecomputations/dolphin-2.6-mixtral-8x7b

and my deepinfra api key and use deepinfra models on cursor
2

Its working. Your settings are just wrong.

Base URL is: https://api.deepinfra.com/v1
and add the model like " google/gemma-7b-it" as example

3

I figured that out but I keep getting a error

4

image-1-1

5

Sorry i was mistaken its https://api.deepinfra.com/v1/openai
Make sure you press the arrow after entering your API Key.

Screenshot 2024-03-21 at 11.17.08

6

Yes ik I still get the error when it is mid generation

7

then u dont have money on it

8

I have confirmed on the deepinfra site have the quota limit at $15 and haven’t used 1% yet