Introducing MentalHealthBench
OpenAI announces MentalHealthBench, an open benchmark of synthetic mental health conversations (adults, teens, caregivers, clinicians; multiple languages) spanning non-acute, high-acuity and emergency cases. More than 80 licensed psychologists and psychiatrists from 22 countries wrote weighted rubric criteria (-10 to +10), retained only with at least two-expert agreement, and GPT-5.6 Sol grades responses across ten behavior dimensions such as safety, seeking context, preserving user agency and actionable guidance. A companion study with 44 adult users compared user and expert preferences, finding users value practical next steps and tone more while experts stress context gathering.
Organisations named here
- OpenAI
- Partnership on AI
- Transluce
- HealthBench
- HealthBench Professional
Technologies named here
- MentalHealthBench
- GPT-5.6 Sol
- ChatGPT
- Trusted Contact
- ChatGPT for Teens
Techniques named here
- Expert-written weighted rubric grading
- Privacy-preserving synthetic conversation generation
- Teen persona via system message
- User versus expert rating comparison
Related in evals


