Skip to content

Back to the catalog

Terminal-Bench 4.0 leaderboard
artificialanalysis.aiother

Terminal-Bench 4.0 leaderboard

Artificial Analysis' leaderboard for Terminal-Bench 4.0, a 66-task benchmark of complex terminal work spanning software engineering, machine learning, science, operations, security, hardware and media, with recalibrated compute/time budgets and improved verifiers over prior versions. The page ranks models/agents by score, cost per task, output tokens per task, and time per task, and links out to related Artificial Analysis evaluations (GDPval-AA, APEX-Agents, Harvey's Legal Agent Benchmark, ServiceNow EnterpriseOps-Gym, Terminal-Bench 2.1, GPQA, MMLU-Pro, AIME, LiveCodeBench and others) used to benchmark frontier agentic and reasoning capability.

TL;DR Live leaderboard ranking AI agents on Terminal-Bench 4.0's 66 hard command-line tasks, with cost/speed/score breakdowns.

Organisations named here

  • Artificial Analysis
  • OpenAI
  • IBM
  • Harvey
  • Surge AI
  • ServiceNow
  • Wisedocs
  • AIME
  • APEX-Agents
  • GDPval
  • GPQA
  • LiveCodeBench
  • MMLU-Pro
  • MMMU
  • Terminal-Bench
  • terminal-bench-2.1

Technologies named here

  • Stirrup