# Why are agents (including Cursor) not ranked on coding benchmarks?

**URL:** <https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820>\
**Category:** Discussions\
**Created:** [April 8, 2025, 8:18pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820 "2025-04-08T20:18:53Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![kendonB](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/kendonb/32/9527_2.png) [@kendonB](https://forum.cursor.com/u/kendonB)\
**Post date:** [April 8, 2025, 8:18pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820/1 "2025-04-08T20:18:53Z")

</div>

Aider ([Aider LLM Leaderboards | aider](https://aider.chat/docs/leaderboards/)) is a very well respected benchmark. Cursor Agent would almost certainly beat the best in this table, since it uses the top two models that are there, and can check its own work.

---

<div class="post-metadata">

**Author:** ![knakamura13](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/knakamura13/32/45445_2.png) [@knakamura13](https://forum.cursor.com/u/knakamura13)\
**Post date:** [April 8, 2025, 9:51pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820/2 "2025-04-08T21:51:45Z")

</div>

Aider is also an agent (a director competitor to Cursor, in fact).

As for why no one has ranked the agents in their own leaderboard, that is an excellent question. I for one would love to see someone benchmark Cursor, Aider, Claude Code, etc., using the strongest LLMs of course. The benchmarks would have to be structured differently though, testing the agent’s understanding of large codebases instead of smaller code snippets.

---

<div class="post-metadata">

**Author:** ![condor](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/condor/32/73148_2.png) [@condor](https://forum.cursor.com/u/condor)\
**Post date:** [April 8, 2025, 9:57pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820/3 "2025-04-08T21:57:48Z")

</div>

I agree, but there should be separate categories, TUI and GUI agents. not everyone can or will use TUI where others wont use GUI.

The same set of tasks and same models would need to be used. but its slightly hard due to specific differences of the agents capabilities.

Its not just understanding codebases but being able to do a task efficiently

---

<div class="post-metadata">

**Author:** ![ShiRaTo](https://avatars.discourse-cdn.com/v4/letter/s/bbe5ce/32.png) [@ShiRaTo](https://forum.cursor.com/u/ShiRaTo)\
**Post date:** [April 14, 2025, 11:55pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820/4 "2025-04-14T23:55:08Z")

</div>

livebench just release this bechmark on Coding Agent tools and tried to use the same LLM to focus only on tool capability.

This might answer your question.

> **[LiveSWEBench](https://liveswebench.ai/)**
>
> LiveSWEBench - A Benchmark for Software Engineering Capabilities of Large Language Models

---

<div class="post-metadata">

**Author:** ![system](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/system/32/99069_2.png) [@system](https://forum.cursor.com/u/system)\
**Post date:** [May 14, 2025, 11:56pm UTC](https://forum.cursor.com/t/why-are-agents-including-cursor-not-ranked-on-coding-benchmarks/76820/5 "2025-05-14T23:56:03Z")

</div>

Closed on May 14, 2025, 11:56pm UTC

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
