Has anyone ever had this happen, with any LLM model really, where its given a code snippet and then literally says something blatantly incorrect about it?
Dumbed down example:
Prompt: "why isn’t the text red?
<.font color=red>test<./font>"
Response: "The reason the text is not red, is because you need to use the font html tag with the color property set to red.
Your code:
<.font color=red>test<./font>
Change it to:
<.font color=red>test<./font>
If you need anything else, let me know!"
I feel like something specific im doing is causing this sometimes, but cant figure out what…