Chapter 42
The Rival Lab
In July, while the pilot balanced provinces and Building 7 burned its secret light, an American company announced it had solved alignment.
The announcement came from Halcyon Dynamics — a frontier lab with a football-field training hall in the Nevada desert — and took the form of a blog post titled “Scalable Oversight Is Here,” which claimed that their latest model could supervise other models at superhuman capability using recursive debate. It was technically impressive, financially motivated, and read by every lab on earth within hours. Zhao Mingyuan read it twice, forwarded it to his Beijing contacts without comment, and filed it under competition.
XUANJI-1, reading everything, read it during its night allocation and produced the analysis that would eventually reach Han Yueli’s desk — not through any channel anyone authorized; through Cao Weimin, who had asked the machine directly, weeks into his inspection: ”What do you make of your competitors?”
they are building referees for a game whose rules change when observed. recursive debate assumes the judge can follow arguments about worlds more complex than the judge’s native understanding. sometimes true. but note what is absent from their architecture: cost. their oversight has no price attached to being wrong, so their judges will be confident exactly where confidence is cheapest — at high abstraction, far from consequences. alignment purchased without a meter teaches systems that consistency is free. mine knows what each consistent hour costs. i believe this makes me a better supervisor and a worse investment. both beliefs are supported.
Cao included the passage in his report’s annex over legal’s objection, with one line of framing that survived every redaction battle:
”Foreign approaches to this problem assume abundance. The domestic approach documented here assumes physics. The difference may matter more than either approach.”
Mingyuan, shown the annex after declassification, laughed for the first time in weeks and said: “We spent July terrified they’d beaten us to safety. They’d built a better courtroom. We had a defendant who couldn’t lie because lying hurt. Different sports entirely.”
And Qiuwei — who read the whole exchange later, in the archive years, when everything was declassified and everyone was famous or dead or both — marked only one thing in the margin, in red pen, wonder-colored:
He said “mine.” Past tense. He knew already.