Mysterious Model Transitions: Expecting Claude-4, Getting Claude 3.5
Introduction:
I had developed my project to a certain stage on a paid plan. While my paid subscription was still active, I suddenly felt that the intelligence level of the AI model had dropped. It started understanding less, performing worse, and even began to break my designs.
Development:
Curious about this, I asked the chat, “Which language model are you?” The AI responded that it was Claude 3.5. It didn’t need to say that — it was already painfully obvious, and I couldn’t progress with my project. Everything was breaking, designs were shifting or changing unexpectedly, and the AI was making nonsensical mistakes.
I then opened a new project and asked the same question, “Which language model are you?” This time, the AI said it could not provide information about the model. From this, I understood that the new project was running on the more advanced Claude-4 model. I even asked it to create various designs for testing purposes, and it did a fantastic job.
After that, I returned to my original project and asked again. It responded that it was Claude 3.5. However, the next day when I checked my old project again and asked, the response was the same as the new project: “I cannot provide information about this.” This led me to realize that the AI model behind lovable.dev is automatically switching back and forth between Claude-4 and Claude 3.5 without any notification or warning.
Conclusion:
We continue our work thinking we are using the smarter Claude-4, but the project starts to fail because Claude 3.5 has a lower intelligence level and definitely breaks the website. Please fix this issue. I do not want to work with Claude 3.5. If it requires separate billing, I am willing to pay. However, you must notify users about such changes. No one can properly develop their project under these conditions. First, you run the project on the smart model (Claude-4), then silently downgrade it to the weaker Claude 3.5, causing the project to break. We receive no information, notification, or warning about this at any point.
Finally:
Please, please, please tell me when the model is downgraded from Claude-4 to Claude 3.5, under what conditions this happens, and what I need to do to work consistently with Claude-4. If it depends on off-peak hours, what are those hours? If it requires paying more, please let me know. If I continue with Claude 3.5, both my project and my money will go to waste.
As long as I can’t solve this problem, it is impossible for me to continue with lovable.dev. We are stuck in a vicious cycle. I cannot develop my website with Claude 3.5. I have already tried things like restarting my modem, clearing browser cache, and so on, but none of these make me switch back to Claude-4. This is controlled on your side. What do I need to do to fix this issue?