arxiv.orgpaper

Compile by Training: Turning Natural-Language Specifications into Local Neural Functions

Presents "compile by training," a method that turns a natural-language task specification into a reusable, locally-run neural function: teacher models generate task-specific training examples that are used to fine-tune a small adapter on a compact interpreter, avoiding repeated calls to a remote large model. On FuzzyBench-Hard (a subset where the faster "Program-as-Weights" compiler produced no exact matches), this approach reaches 83.6% semantic accuracy at the cost of roughly a minute of compile time versus seconds. The authors deploy compiled functions in a public interactive service, including a website helper, a language-controlled 3D avatar, and a bidirectional English-Claudish translator.