openai.comarticleLifeVal
LifeVal is an OpenAI evaluation that measures how well ChatGPT models complete everyday life tasks such as childcare search, government services, budgeting, shopping and health. Tasks were derived from the American Time Use Survey, the Multinational Time Use Study and a new demographically representative survey of 3,995 respondents. OpenAI says it used the eval over the past year to track gains in browser use, computer use and connectors. The fetched text gives no scores or task list.
TL;DR OpenAI introduces LifeVal, a benchmark of everyday-life tasks built from time-use surveys to track ChatGPT's progress as an agentic personal assistant.
Organisations named here
- OpenAI
- Bureau of Labor Statistics
- American Time Use Survey
- Multinational Time Use Study
Technologies named here
- ChatGPT
- LifeVal
Techniques named here
- Survey-based task selection for evaluation
Concepts named here
- Agentic personal assistant
- Everyday task evaluation
Related in evals
