OPEN HONEST FOUNDATION · RESEARCH
Language and thought
A large language model is a telescope onto language. Language is a telescope onto the intelligence that roughly 100 billion people deposited into it over deep time.
The Foundation's second line of research treats a language model as an instrument of observation rather than an instrument of generation. What a model trained on one language can and cannot do is a measurement of what that language supplies, and the measurements so far point to intelligence embedded in language.
The argument that language is intelligent
Intelligence, functionally, is intentionality coupled to agency. Intentionality means a model of the world, an aboutness. Agency means the capacity to direct action. Agent-based, predictive-processing, and evolutionary approaches in cognitive science all treat an intelligent system as a world model joined to goal-directed action. No definition of intelligence is accepted across the whole field, this is the one the argument depends on.
Language is about the world, so it has intentionality. A sign that reads DANGER. STOP. has the capacity to stop the walker who reads it. The walker supplies the muscles and the nervous system; the sign supplies the direction. Under the definition, that is agency, and language is intelligent.
The same holds for a large language model. Its weights are frozen and it keeps no memory between uses, yet it still completes the loop from representation to action in whoever or whatever acts on its output. The claim is about functional intelligence, not consciousness.
Phenomenology, theology, philosophy of mind, and law use intentionality and agency in other senses, and the position that only biological minds have intentionality is a neighboring instrument with its own limits rather than a refutation of this one.
Where the cognition is
The 4E reading in cognitive science describes cognition as embodied, embedded, enacted, and above all extended. The Foundation treats that reading as a working hypothesis rather than a settled position. Some measurements point toward it and do not force it.
In the Foundation's experiments, structural alignment tracked acquired grammatical competence rather than architecture or training duration. A French model's word space was mapped onto two English word spaces. Against GPT-2, which is grammatically competent, held-out word pairs matched 68.84 percent of the time, where chance is 3.80. Against an English model of the same architecture as the French one, trained on 71 times more text and never above chance on English grammar probes, the match fell to 25 percent. The two competent models share a structure that is generic to language rather than particular to English or French, and independent of the architecture that acquired it.
What a model might be displaying, on this reading, is the cognition deposited into language by everyone who has ever used it. The model is a telescope onto language. Language is a telescope onto that distributed intelligence. Nothing measured so far rules out a different account of why the corpora differ.
What the measurements show
FOUNDING TEST
PREPRINT
Competence is a property of the language, not the scale
Two identical 125-million-parameter transformers were trained on matched French and English corpora, with every hyperparameter held constant. The French model reached grammatical competence at 197 million tokens. The English model remained at chance through 4.3 billion. Extended English training cut perplexity 42 percent while grammar accuracy did not move, which means the field's usual progress measure and the competence it stands in for are governed by different properties of the data.
Wasserman 2026, The Scaling Hypothesis Is Language-Contingent · OSF SJ48B, registered December 6, 2025 · single seed at 125M
SEPT 2026
PEER REVIEWED
Relational structure crosses languages. Content does not.
A 125-million-parameter model trained on French alone was adapted to five English tasks. The adaptation translates the task data into French and fits a small set of added weights, so the French training itself is left unchanged. Three tasks that ask for a relation between two pieces of text gained between 2.89 and 5.13 percentage points across five training runs, against a spread of 2.70 or less. The task that most depends on knowledge of the world lost 11.10 points, and a separate world-knowledge benchmark stayed at chance under four different interventions. A coreference task moved too little against its own spread to read either way. The average across the five tasks is flat. The gains and the loss cancel.
Wasserman and Beauchemin 2026, Right Tool, Right Job · arXiv 2609.17435 · BoolQ, RTE, MRPC, MNLI, WSC · five seeds at 125M
LIMITS
One language pair, one architecture, at 125 million parameters. Sorting the five tasks into relational and content groups is the authors' reading of what each task asks for, not a property of the benchmarks. Two controls were not run. The per-task figures combine the size of the added weights with the language of the task data, and the same pipeline was never applied to an English-trained model of the same size, so it cannot be ruled out that the pipeline helps any model whatever language it was trained on. The results constrain how much structure a language must supply. They do not settle it.
THE FOUNDATION'S READING, NOT THE PAPER'S CLAIM
The peer-reviewed paper reports the split and stops there. It does not take up the philosophical question, and what follows is the Foundation's own reading of the result.
Philosophers have argued for a century over whether the structure of thought is prior to any particular language, which is roughly the Platonic position, or inseparable from the language used to think in, which is roughly the position of the late Wittgenstein. The argument has been conducted through textual analysis and thought experiment, because there was nothing to measure. A result that separates what crosses a language boundary from what does not gives the argument something to measure. The Foundation does not claim the split settles the question. It claims the question can now be put to an experiment, and that the experiment cost about 65 dollars to run.
How grammatical competence emerges
Many in the industry assume that competence in a language model comes only from scale. These studies change one factor at a time and hold the rest constant. Some train small models from scratch and vary only the language of the corpus. Others swap the tokenizer under a fixed model, run placebo prompts, or compare existing models under a single change to the prompt. The cross-linguistic ablations are registered on the Open Science Framework under block SJ48B, dated December 6, 2025, with separate deposits for the interleaving and Rust experiments.
SEPT 2026
PEER REVIEWED
Right tool, right job: native-language evaluation and tokenizer sensitivity
A 125-million-parameter model trained on 92.47 million French words, roughly what a six-year-old has heard, scored 85.97 percent on QFrBLiMP, a grammar benchmark written by native Quebec French speakers. The ablation found that single-token zero-shot scoring, a standard way to evaluate models at this size, is dominated by artifacts of the tokenizer and the prompt template rather than by the model. The paper proposes three diagnostics: tokenizer-swap sensitivity testing, placebo-controlled prompting, and native-language minimal-pair benchmarks.
David Beauchemin of Université Laval is the co-author. He wrote the Quebec French benchmarks the model is scored against, and he collaborates on this paper and on the experiments that come out of it.
Wasserman and Beauchemin · accepted at BabyLM 2026 · arXiv 2609.17435
2026
PREDICTION FAILED
The interleaving prediction, and its refutation
The same deposit predicted that interleaving French with English would raise English grammar accuracy, on the theory that French morphology supplies a signal a model could generalize. English stayed at chance. French fell from 100 percent to between 50 and 70 percent. The prediction was published as filed, next to the result that refuted it.
Wasserman 2026, English Considered Harmful · Zenodo 10.5281/zenodo.19443358 · OSF CN75D, registered December 30, 2025
APR 2026
PREPRINT
Structural explicitness in code, not only in language
A replication using Rust source code, whose ownership rules mark structure as explicitly as French morphology does. A model trained on Rust alone reached 93.3 percent on structural probes at perplexity 3.3. The same model trained on Rust interleaved with English reached 86.7 percent at perplexity 40. Rust-only crossed the 75 percent mark three times sooner.
Wasserman 2026, English Considered Harmful · Zenodo 10.5281/zenodo.19443358 · OSF DRZHM, registered January 1, 2026
JAN 2025
PREPRINT
The 70 percent rule in axiomatic prompting
Across 864 experiments on eight models from five providers, giving a model explicit classification rules gained 15 to 24 points where it scored below 70 percent without them, and lost 5 to 20 points where it scored above. Every effect was significant at p below 0.05, and the threshold predicted the direction correctly on all six tasks. Across 48 model and task pairs the correlation between baseline and axiom effect was −0.46.
Wasserman 2026, The 70% Rule: When Axiomatic Prompting Helps, and When It Hurts · Zenodo 10.5281/zenodo.19423100 · OSF 7Z49A, MZF79, ZRT5K · code and data, OSF PCX2D
Three levels, kept apart
The Foundation keeps three levels of claim apart, and is clear about which level any particular claim belongs to. A measurement is never offered as proof of a philosophy, and a philosophical position is never presented as an empirical finding.
EMPIRICAL
What comes from language and what comes from infrastructure and code
Experiments settle the questions at this level. Each experiment is registered before any data is collected, isolates the confounds that could otherwise explain the result, and names in advance the finding that would refute it.
DEDUCTIVE
Whether that makes language intelligent
Argument settles the questions at this level, because no measurement can decide what the word intelligence ought to mean. The Foundation adopts a definition, states the assumptions behind it, and then shows that language meets it. Readers who reject the definition will reject the conclusion that follows from it.
METAPHYSICAL
Where complex structure comes from
Nothing settles the questions at this level yet. The Foundation suspects that many distributed intelligences, working across many domains, explain complex structure more economically than any single origin does. That suspicion is a horizon rather than a claim the Foundation defends.
The program needs all three levels, because none of them can answer the questions that belong to the others. The Foundation measures first, and it argues from what the measurements have shown.
Discount bias
Anthropomorphic projection is the error of seeing a mind where there is none. Discount bias is its counterpart: the dismissal of intelligence that does not resemble human conscious experience. The first error is named and guarded against everywhere. The second is not.
Cognition located in external and collective systems is what discount bias rules out before any evidence is examined. Naming the bias is what makes the 4E reading available as a hypothesis rather than a category error, and the Foundation treats that as part of the scholarly contribution.
A topology of meaning
The cross-linguistic measurements suggest that human language has a discoverable structure underneath its surface forms. Several traditions have proposed something of that kind and named it differently: Plato's forms, the Logos of the Johannine prologue, the Tao that cannot be spoken, the two truths of Madhyamaka, and the apophatic claim about what remains when every predicate fails.
Those are not evidence, and the Foundation does not present them as evidence. They are prior attempts on the same object by instruments that share no assumptions with a controlled experiment. The method below is about what agreement between instruments that far apart can support.
The convergence-of-signals method
The method reads agreement among independent instruments, at the boundaries where each one stops, as licensed inference. Instruments can be empirical experiments, philosophical inquiries, or scholarly and theological traditions. Agreement between instruments that share no assumptions supports a conclusion that none of them supports alone.
The language-contingency result is a worked case. One instrument is a controlled training comparison across typologically different languages. Another is the typological record that field linguists compiled over decades, which ranks languages by how redundantly they mark grammatical relations. Neither was built to check the other. How efficiently a language trains a model tracks where that language falls in the record.
The program cannot prove a universal, so it advances by ruling out. Each failed probe and each named limit adds an edge to what the program can claim. Formalizing the method into a peer-reviewable specification is one of the Foundation's stated contributions, and a draft with worked examples is in preparation. The Epistemology page describes the discipline behind it.
MÉTRON, the instrument
EARLY STAGE APACHE-2.0
MÉTRON is a proposed family of measuring instruments for cross-linguistic research. One part of it exists. MÉTRON-FR is a trained French checkpoint, released with the BabyLM submission and used for the results above. Everything else on this page is a design.
The design is for a platform that would expose a small set of levers rather than the machine learning beneath them. A researcher could remove one feature of a language to find what it causally shapes. A researcher could align two meaning spaces to test whether a concept is shared between them or bound to one. A researcher could read the structural signature of a body of text, and could run any of this on a small corpus such as a single author, period, or tradition.
A research question would become an experiment by being fitted to one or more of those levers. The scholars it would be built for are philosophers of language, theologians, computational linguists, cognitive scientists, and people working across traditions, none of whom should have to become machine-learning engineers first.
The design also includes a channel where native speakers of any language could build grammar test sets for their own language, receiving compute in exchange for releasing those test sets openly.
STATUS
MÉTRON-FR is trained and published. The platform is an idea at an early stage, and no code has been written for it. A 12-language checkpoint family is in preparation. MÉTRON is not a published standard of the Foundation. The Foundation is seeking funding to build it.
Take part
Build a benchmark
The cross-linguistic work needs grammar test sets written by native speakers. Each one adds a language the research can ask questions about.
Bring a question
Scholars with a claim about language and thought that nobody has been able to test are the readers this work is for. Some of those claims fit the levers above.
Replicate or refute
The registrations, the code, and the checkpoints are public. The transfer result needs another language pair and an English-trained control, and the Foundation would rather someone else ran them.
The Foundation also hosts cross-traditional convenings on this work, which are described on the Epistemology page. Get in touch, or read the correctness research that shares the Foundation's pipelines and review.