Recent benchmarks increasingly report that large language models (LLMs) exhibit human-like causal reasoning abilities, including counterfactual inference and intervention planning. However, many such evaluations rely on domains that are heavily represented in training data and embed strong semantic cues, raising the possibility that apparent causal competence may reflect semantic pattern recombination rather than structure-sensitive causal reasoning. Drawing on human developmental theories of causal induction, this perspective argues that genuine causal understanding requires robustness to novelty and reliance on conditional structure rather than semantic familiarity. To illustrate the testability of this claim, the paper includes a pilot demonstration using synthetic causal micro-worlds. Identical numerical evidence was presented to a LLM under two conditions: semantically meaningful variable labels and non-semantic coded labels. Across paired cases, the model reliably selected the correct causal structure when labels were meaningful, but frequently misidentified or exhibited instability in causal model selection under coded labels, despite producing locally coherent explanations. These divergences emerged most clearly in diagnostically ambiguous settings requiring suppression of misleading marginal associations. The results align with the claim that semantic scaffolding can support and stabilize apparent causal competence in LLMs without implying structure-sensitive reasoning.
The Illusion of Causality in LLMs: A Developmentally Grounded Analysis of Semantic Scaffolding and Benchmark–Capability Mismatches
Published 2026 in Machine Learning and Knowledge Extraction
ABSTRACT
PUBLICATION RECORD
- Publication year
2026
- Venue
Machine Learning and Knowledge Extraction
- Publication date
2026-03-02
- Fields of study
Not labeled
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-16 of 16 references · Page 1 of 1
CITED BY
- No citing papers are available for this paper.
Showing 0-0 of 0 citing papers · Page 1 of 1