Linguistic Units as Tokens: Intrinsic and Extrinsic Evaluation with BabyLM

,

• Publication year

  2025

• Venue

  Proceedings of the First BabyLM Workshop

• Publication date

  Unknown publication date

• Fields of study

  Not labeled

• Identifiers
  DOI 10.18653/v1/2025.babylm-main.35
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora

  2025cited by this paper
• Recurrent Networks Are (Linguistically) Better? An (Ongoing) Experiment on Small-LM Training on Child-Directed Speech in Italian

  2024influential reference
• The Impact of Token Granularity on the Predictive Power of Language Model Surprisal

  2024cited by this paper
• Byte Latent Transformer: Patches Scale Better Than Tokens

  2024cited by this paper
• When Every Token Counts: Optimal Segmentation for Low-Resource Language Models

  2024cited by this paper
• From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes

  2024cited by this paper
• Small Language Models Also Work With Small Vocabularies: Probing the Linguistic Abilities of Grapheme- and Phoneme-Based Baby Llamas

  2024cited by this paper
• Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models

  2024cited by this paper
• Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

  2024cited by this paper
• Cloze probability, predictability ratings, and computational estimates for 205 English sentences, aligned with existing EEG and reading time data

  2023cited by this paper
• Call for Papers - The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus

  2023cited by this paper
• The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

  2022cited by this paper
• SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems

  2019cited by this paper
• BLiMP: The Benchmark of Linguistic Minimal Pairs for English

  2019cited by this paper
• GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

  2018cited by this paper
• Unsupervised Morphology Learning with Statistical Paradigms

  2018cited by this paper
• Neural Correlates of Morphology Acquisition through a Statistical Learning Paradigm

  2017cited by this paper
• The Price of Linguistic Productivity: How Children Learn to Break the Rules of Language

  2016influential reference
• Morphology and Language Acquisition

  2016cited by this paper
• Neural Machine Translation of Rare Words with Subword Units

  2015cited by this paper
• Unsupervised Learning of the Morphology of a Natural Language

  2001influential reference
• A new algorithm for data compression

  1994cited by this paper
• A precursor of language acquisition in young infants.

  1988cited by this paper
• The Child's Learning of English Morphology

  1958cited by this paper

• Findings of the Third BabyLM Challenge: Accelerating Language Modeling Research with Cognitively Plausible Data

  2025cites this paper