What happened? Now the answer come much faster than earlier today.
What happened? Now the answer come much faster than earlier today.
Perhaps, speculating, it is due to how the token/second rate of its provider Fireworks.ai has improved.
Hey, we have been working with our partners at Fireworks to get the speed up, so I’m glad you’re seeing faster performance now.