Fable on Legibility

Claude Fable is Anthropic’s most capable publicly available “Mythos-class” model. It is optimized for long-running autonomous tasks and deep knowledge work. The roll out of this product has been dramatic. Little people like me have access to it for only two weeks, and I doubt I will be able to afford it thereafter. With my window of access, I posed it the following prompt:

“This article indicates that a much smarter model might not be possible because the universe is opaque. Since Tyler Cowen made this statement, AI has helped people make breakthroughs in math and biology. Write this again in 2026 using the latest state of technology. Is the smartest LLM today much smarter than GPT-4? And is the universe legible?” and I copied in my blog post Is the Universe Legible to Intelligence?

Fable replied in 3 pages of text which you can download as a Word doc here.

One line from Fable’s response: “Notice where the wins clustered: mathematics with checkable proofs, protein structures with experimental ground truth, contest problems with known answers. These are the maximally legible domains — places with a fixed target and a way to verify that you hit it.”

The writing is coherent and contains no obvious hallucinations. Is the answer true, and does it tell the whole truth?

Whenever you read something think about who wrote it, and keep in mind that every author/model has a bias and limitations. In my paper with Will Hickman, we found that just reminding people that a paragraph has an author (whether the author is human or AI) increased the demand for fact checking from readers. LLMs will become more persuasive and closer to (but never completely) correct. Keep reading all things with some skepticism whether they are written by scientists, politicians, or AI.

Regardless, there is definitely such a thing as making the known world more legible to AI today. Thus, people are talking about increasing funding for data availability and the possible demise of the “research paper.”

Research papers are more like stories than facts. The demand for stories is not going away, but I definitely cannot predict the future of the write-for-pay scientist.

AI, potentially, could go and get its own new data, instead of waiting for humans to archive it. Thus, the self-improving AI might take us beyond the current models… unless they run up against something that is not legible to intelligence…

Leave a comment