Skip to content

Back to the catalog

Why AlphaFold Didn't Solve Protein Folding — Pushmeet Kohli, Google DeepMind & Sal Candido, Biohub
latent.spacetalk

Why AlphaFold Didn't Solve Protein Folding — Pushmeet Kohli, Google DeepMind & Sal Candido, Biohub

Transcript of a panel moderated by Brandon Anderson with Pushmeet Kohli (Google DeepMind) and Sal Candido (Biohub). They discuss a "bitter lesson" for biological data: finding the right scaling law and good data matters more than raw scale. Low-quality metagenomic sequences can still improve protein language models, and AlphaFold 2's handcrafted inductive biases made it data-efficient. They also cover why protein folding isn't fully solved (dynamics, disorder, cryo-EM micrographs as a richer data source), the need for calibrated uncertainty (pLDDT) over full interpretability, hidden knowledge in protein language models, and the move from single-protein models to a virtual cell.

TL;DR Panel with DeepMind's Kohli and Biohub's Candido on scaling laws, data quality, inductive bias and interpretability for biology AI, and why AlphaFold didn't fully solve protein folding.
Document

What it claims

This is a 30-minute conference panel, not a paper, so it reports no new results. It carries a few first-hand observations from the people who built these systems that the summary flattens:

  • What AlphaFold 2 actually optimised. Kohli says the target was never the true ground state or the distribution of conformations a protein takes. It was to reproduce the single structure someone had deposited in the PDB. The "solved" framing applies only to that proxy. Dynamics, disorder and context-dependent shape remain open.
  • A failed virtual-cell attempt. DeepMind applied its AlphaFold-style approach to cell-by-gene data and concluded "after a lot of work" that the data was not yet sufficient to build a virtual cell. This is a concrete negative result for anyone planning to model single-cell expression data.
  • Inductive bias has a tipping point. Candido says handcrafted bias pays off at small data scales. At larger scales a bias that is "not exactly correct" can hold the model back. AF2's residue-interaction bias was justified because the PDB was fixed and could not be expanded by an order of magnitude.
  • Noisy data can help. Training protein language models on metagenomic sequences, many of which are "not even a real, whole protein," still improved design of working proteins and understanding of known ones. Kohli adds that replicating the same data gains nothing, so coverage matters more than volume.
  • Protein language model representations hold more than structure. Biohub's interpretability work finds information about function and motion in the representations, not only structure.
  • Trust comes from calibration, not mechanism. Kohli puts AF2 at a GDT of about 90 on the evaluation set of the time. He argues a GDT of 95 with uncalibrated pLDDT would have been untrustworthy. AF2's usefulness as a disorder predictor was found by outside users only after the weights were released, not characterised before launch.

Limits

  • Every claim is an opinion or anecdote from a panel. There are no ablations, datasets, sizes or compute figures.
  • The GDT ≈ 90 figure comes with no named benchmark beyond "that set at the time," and no baseline.
  • Kohli's attempt to train directly on cryo-EM micrographs is reported only as "tried it, but it requires more work," with no details.
  • The cell-by-gene result gives no detail on which data or models were tried.
  • The metagenomic-data claim names no model, dataset or metric.
  • The panel gives no timeline for AI-driven drug discovery. Both speakers decline to quantify one.
  • Read it for framing and for the negative results above, not for anything you can reproduce or adopt.

Organisations named here

  • Google DeepMind
  • Biohub
  • Alphabet
  • Google
  • Protein Data Bank
  • BBI
  • Latent Space
  • Brandon Anderson
  • John Jumper
  • Pushmeet Kohli
  • Richard Sutton
  • Sal Candido

Technologies named here

  • AlphaFold 2
  • AlphaFold
  • Protein language models
  • Transformer

Techniques named here

  • Finding the scaling law
  • Training protein language models on metagenomic sequences
  • Baking in scientific inductive bias
  • Uncertainty calibration
  • Interpretability of model representations
  • Learning from cryo-EM micrographs