Be realistic with Grok-4

[Artemonim]

My one-shot post has become constantly updated review. You might also be interested.

(Continuously Updated) My Real-Time Review of Grok 4

I’ve been trying to develop a CAT tool for personal use for almost a week now. I wrote an incremental integration test with 48 tasks to track progress and follow a TDD-style development workflow. [2025-07-09_21-03-26] I’ve hit a wall at Task 20 — none of the available LLMs have managed to pass it so far. I’ve tried everything, both individually and in relay races: Gemini 2.5 Pro, Gemini 2.5 Pro MAX, Claude 4, Claude 4 MAX, o4-mini, o3, o3-pro (Manual mode one-time situation analysis), and Aut…