Terminal-Bench 4.0 leaderboard
Artificial Analysis' leaderboard for Terminal-Bench 4.0, a 66-task benchmark of complex terminal work spanning software engineering, machine learning, science, operations, security, hardware and media, with recalibrated compute/time budgets and improved verifiers over prior versions. The page ranks models/agents by score, cost per task, output tokens per task, and time per task, and links out to related Artificial Analysis evaluations (GDPval-AA, APEX-Agents, Harvey's Legal Agent Benchmark, ServiceNow EnterpriseOps-Gym, Terminal-Bench 2.1, GPQA, MMLU-Pro, AIME, LiveCodeBench and others) used to benchmark frontier agentic and reasoning capability.
TL;DR Live leaderboard ranking AI agents on Terminal-Bench 4.0's 66 hard command-line tasks, with cost/speed/score breakdowns.
Organisations named here
- Artificial Analysis
- OpenAI
- IBM
- Harvey
- Surge AI
- ServiceNow
- Wisedocs
- AIME
- APEX-Agents
- GDPval
- GPQA
- LiveCodeBench
- MMLU-Pro
- MMMU
- Terminal-Bench
- terminal-bench-2.1
Technologies named here
- Stirrup
Related in evals


