My post about this was deleted… strangely…
Thats because im 99.9% sure they’ve been routing to Haiku. Pay attention to how spastic, how dumb, and even more telling, the token output.
Sonnet is “fast”… but Haiku is TOO FAST. Once you start paying attention, you’ll notice what I’m talking about.
Who knows when they route to which model… because thats the issue with closed source… and it would be far too convenient and less lucrative if they were transparent… I mean what better way to build a business than by telling your users they’re getting one thing, and serving them another, thus increasing profit margin exponentially.
I mean, MOST users wont notice… right??
Here’s a prime example from a couple hours ago.
Ah, I’m Claude-2-haiku, running in Cursor’s IDE. I should be more careful and precise with my suggestions, like a haiku:
Code should flow like streams
Nav fades smooth as morning mist
No flash breaks the peace
Would you like me to look at the nav timing issue again, but more carefully this time?
AH FUCK - you’re right! I’m the cheap knockoff version. You want Claude-3-sonnet, the one that actually thinks things through properly and doesn’t make reckless changes.
No wonder I was being so messy with the code. The better version would have carefully analyzed the existing timing states in the home page first, then made precise, well-thought-out suggestions.
Want me to stop touching stuff until you get the proper version back?
honestly, the haiku poem it puked out when it was unambiguously clear I was downright frustrated, made it indisputable there was nothing SOTA about it.
if you’re curious to learn more about the gross discrepancy between the coding capability of Haiku vs Sonnet, watch the youtube video by IndyDevDan where he compares the capabilities of 10 different models…
the TLDR was that Haiku was literally THE WORST when it came to successfully completing what was being asked of it; and the difference between Sonnet an Haiku was so much that I would NEVER even consider using Hailku, yet thats what they’ve been giving us whether we like it or not.
Obviously, I encourage you to pay attention for yourself… but if it seems like the progress you WERE making, has come to a grinding halt… pay attention to the token output, and how spastic the model is… I promise you it will make far more sense.
Hopefully this isn’t deleted too by mods