Skip to content

Back to the catalog

openai.comarticle

Introducing MentalHealthBench

OpenAI announces MentalHealthBench, an open benchmark of synthetic mental health conversations (adults, teens, caregivers, clinicians; multiple languages) spanning non-acute, high-acuity and emergency cases. More than 80 licensed psychologists and psychiatrists from 22 countries wrote weighted rubric criteria (-10 to +10), retained only with at least two-expert agreement, and GPT-5.6 Sol grades responses across ten behavior dimensions such as safety, seeking context, preserving user agency and actionable guidance. A companion study with 44 adult users compared user and expert preferences, finding users value practical next steps and tone more while experts stress context gathering.

TL;DR OpenAI's open MentalHealthBench scores model replies in mental health chats against rubrics written by 80+ licensed experts, broken down across ten behavior dimensions.

Organisations named here

  • OpenAI
  • Partnership on AI
  • Transluce
  • HealthBench
  • HealthBench Professional

Technologies named here

  • MentalHealthBench
  • GPT-5.6 Sol
  • ChatGPT
  • Trusted Contact
  • ChatGPT for Teens

Techniques named here

  • Expert-written weighted rubric grading
  • Privacy-preserving synthetic conversation generation
  • Teen persona via system message
  • User versus expert rating comparison