Learning words from sights and sounds: a computational model

No abstract is available for this paper.

• Publication year

  2002

• Venue

  Cognitive Sciences

• Publication date

  Unknown publication date

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1016/S0364-0213(01)00061-1
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Digital signal processing

  2018cited by this paper
• Elements of Information Theory

  2005cited by this paper
• Teachable Interfaces for Individuals with Dysarthric Speech and Severe Physical Disabilities

  2000cited by this paper
• Learning from multimodal observations

  2000cited by this paper
• Cross-language word segmentation by 9-month-olds

  2000cited by this paper
• Integration of speech and vision using mutual information

  2000cited by this paper
• An Efficient, Probabilistically Sound Algorithm for Segmentation and Word Discovery

  1999cited by this paper
• What is Cognitive Science

  1999cited by this paper
• Word learning in a multimodal environment

  1998cited by this paper
• Learning words from natural audio-visual input

  1998cited by this paper
• A State-Based Approach to the Representation and Recognition of Gesture

  1997cited by this paper
• Machine Learning for Adaptive User Interfaces

  1997cited by this paper
• Serial Order: A Parallel Distributed Processing Approach

  1997cited by this paper
• Infants listen for more phonetic detail in speech perception than in word-learning tasks

  1997cited by this paper
• The perception of rhythmic units in speech by infants and adults.

  1997cited by this paper
• Toco the toucan: a synthetic character guided by perception, emotion, and story

  1997cited by this paper
• The Representation and Recognition of Action Using Temporal Templates

  1997cited by this paper
• When push comes to shove: a computational model of the role of motor control in the acquisition of action verbs

  1997cited by this paper
• Unsupervised language acquisition

  1996cited by this paper
• A computational study of cross-situational techniques for learning word-to-meaning mappings.

  1996cited by this paper
• Probabilistic object recognition using multidimensional receptive field histograms

  1996cited by this paper
• A Rhythmic Bias in Preverbal Speech Segmentation

  1996cited by this paper
• Transcription and Alignment of the TIMIT Database

  1996cited by this paper
• Word Spotting from Continuous Speech Utterances

  1996cited by this paper
• Automatic Speech and Speaker Recognition

  1996cited by this paper
• Syskill & Webert: Identifying Interesting Web Sites

  1996cited by this paper
• Statistical models for topic identification using phoneme substrings

  1996cited by this paper
• Pfinder: real-time tracking of the human body

  1996cited by this paper
• Real-time self-calibrating stereo person tracking using 3-D shape estimation from blob features

  1996cited by this paper
• Statistical Learning by 8-Month-Old Infants

  1996cited by this paper
• MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES

  1996cited by this paper
• Distributional regularity and phonotactic constraints are useful for segmentation.

  1996cited by this paper
• Infants' Recognition of the Sound Patterns of Their Own Names

  1995cited by this paper
• Visual Recognition of American Sign Language Using Hidden Markov Models.

  1995cited by this paper
• Object indexing using an iconic sparse distributed memory

  1995cited by this paper
• Speaker adaptation using constrained estimation of Gaussian mixtures

  1995cited by this paper
• Computer and Robot Vision

  1995cited by this paper
• A dynamical system model for recognizing intonation patterns

  1995cited by this paper
• RASTA processing of speech

  1994cited by this paper
• An application of recurrent nets to phone probability estimation

  1994cited by this paper
• Developmental and stylistic variation in the composition of early vocabulary

  1994cited by this paper
• Early object labels: the case for a developmental lexical principles framework

  1994cited by this paper
• Fundamentals of speech recognition

  1993cited by this paper
• Infants' preference for the predominant stress patterns of English words.

  1993cited by this paper
• From general to language-specific capacities: the WRAPSA Model of how speech perception develops

  1993cited by this paper
• Improving connected letter recognition by lipreading

  1993cited by this paper
• Neural Networks for Pattern Recognition

  1993cited by this paper
• The BBN/HARC spoken language understanding system

  1993cited by this paper
• The periodicity bias

  1993cited by this paper
• Watch what I do: programming by demonstration

  1993cited by this paper
• Connectionist Speech Recognition: A Hybrid Approach

  1993cited by this paper
• The CHILDES project: tools for analyzing talk

  1992cited by this paper
• Automatic detection and modeling of new words in a large-vocabulary continuous speech recognition system

  1992cited by this paper
• Naive physics, event perception, lexical semantics, and language acquisition

  1992cited by this paper
• A Personal Learning Apprentice

  1992cited by this paper
• Linguistic experience alters phonetic perception in infants by 6 months of age.

  1992cited by this paper
• Symbol Grounding or the Emergence of Symbols? Vocabulary Growth in Children and a Connectionist Net

  1992cited by this paper
• Coevolution: Genes, Culture, and Human Diversity

  1991cited by this paper
• Eigenfaces for Recognition

  1991cited by this paper
• From Visual Structure to Perceptual Function

  1990cited by this paper
• The Symbol Grounding Problem

  1990cited by this paper
• Context-dependent phonetic hidden Markov models for speaker-independent continuous speech recognition

  1990cited by this paper
• Backpropagation Through Time: What It Does and How to Do It

  1990cited by this paper
• Finding Structure in Time

  1990cited by this paper
• Phoneme recognition using time-delay neural networks

  1989cited by this paper
• The MIT SUMMIT Speech Recognition System: A Progress Report

  1989cited by this paper
• Unsupervised speaker adaptation method based on hierarchical spectral clustering

  1989cited by this paper
• On automated language acquisition

  1989cited by this paper
• Women, Fire, and Dangerous Things

  1989cited by this paper
• A tutorial on hidden Markov models and selected applications in speech recognition

  1989cited by this paper
• Categorization and naming in children

  1989cited by this paper
• Word boundary detection in broad class and phoneme strings

  1989cited by this paper
• Towards speaker-independent continuous speech recognition

  1988cited by this paper
• Large-vocabulary speaker-independent continuous speech recognition: the sphinx system

  1988cited by this paper
• Language and Experience: Evidence from the Blind Child

  1988cited by this paper
• The importance of shape in early lexical learning

  1988influential reference
• The vocabulary problem in human-system communication

  1987cited by this paper
• Early word meanings: The case of object names

  1987cited by this paper
• Rapid speaker adaptation using a probabilistic spectral mapping

  1987cited by this paper
• Object permanence in 3½- and 4½-month-old infants.

  1987cited by this paper
• Language learnability and language development

  1985cited by this paper
• Intonation Patterns in Child-Directed Speech: Mother-Father Differences.

  1984cited by this paper
• Infant perception of correlations among attributes.

  1983cited by this paper
• Steps Toward Graceful Interaction in Spoken and Written Man-Machine Communication

  1983cited by this paper
• Sex differences in speech to children

  1982cited by this paper
• Least squares quantization in PCM

  1982cited by this paper
• Mindstorms: Children, Computers, and Powerful Ideas

  1980cited by this paper
• Talking to Children: Language Input and Acquisition

  1979cited by this paper
• Language development and language disorders

  1979cited by this paper
• Modification of the externality effect in young infants.

  1979cited by this paper
• Early lexical development: comprehension and production

  1979cited by this paper
• Modeling By Shortest Data Description*

  1978influential reference
• Induction of Augmented Transition Networks

  1977cited by this paper
• Color vision and hue categorization in young human infants.

  1976cited by this paper
• Infants' discrimination of internal and external pattern elements.

  1976cited by this paper
• Cognitive Representations of Semantic Categories.

  1975cited by this paper
• chapter 6 – Speech Perception in Early Infancy1

  1975cited by this paper
• Pattern classification and scene analysis

  1974cited by this paper
• Basic Color Terms: Their Universality and Evolution

  1973cited by this paper
• Orientational selectivity of grating and line detectors in human vision.

  1973cited by this paper

• CPID-MAAC: RL for Joint User Association and Trajectory Control in UAV-Assisted MEC Systems

  2026cites this paper
• The Mechanistic Emergence of Symbol Grounding in Language Models

  2025cites this paper
• On the robustness of modeling grounded word learning through a child's egocentric input

  2025cites this paper
• Learning Language through Grounding

  2025cites this paper
• Grounded language acquisition through the eyes and ears of a single child

  2024cites this paper
• Acquiring Linguistic Knowledge from Multimodal Input

  2024cites this paper
• Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

  2024cites this paper
• Computational Modeling of the Segmentation of Sentence Stimuli From an Infant Word-Finding Study

  2024cites this paper
• Multimodal Language Learning for Object Retrieval in Low Data Regimes in the Face of Missing Modalities

  2023cites this paper
• SITUATION-AWARE SPOKEN LANGUAGE PROCESSING

  2023cites this paper
• World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models

  2023cites this paper
• Communicative Feedback in language acquisition

  2023cites this paper
• Realistic and broad-scope learning simulations: first results and challenges

  2023cites this paper
• MIMo: A Multimodal Infant Model for Studying Cognitive Development

  2023cites this paper
• Signatures of cross-modal alignment in children’s early concepts

  2023cites this paper
• The Role of the Caregiver’s Responsiveness in Affect-Grounded Language Learning by a Robot: Architecture and First Experiments

  2022cites this paper
• A Computational Acquisition Model for Multimodal Word Categorization

  2022cites this paper
• Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machines

  2022cites this paper
• Is it possible not to cheat on the Turing Test: Exploring the potential and challenges for true natural language 'understanding' by computers

  2022influential citation
• Toward Network Intelligence

  2022cites this paper
• Automatic Spoken Language Acquisition Based on Observation and Dialogue

  2022cites this paper
• Mind's Eye: Grounded Language Model Reasoning through Simulation

  2022cites this paper
• Nanoconjugate Synthesis of Elaeocarpus ganitrus and the Assessment of Its Antimicrobial and Antiproliferative Properties

  2022cites this paper
• Learning English with Peppa Pig

  2022cites this paper
• Unsupervised Multimodal Word Discovery Based on Double Articulation Analysis With Co-Occurrence Cues

  2022cites this paper
• Cross-Situational Word Learning With Multimodal Neural Networks

  2021cites this paper
• Can phones, syllables, and words emerge as side-products of cross-situational audiovisual learning? - A computational investigation

  2021cites this paper
• Optimized Human-AI Decision Making: A Personal Perspective

  2021cites this paper
• Learning to Ground Multi-Agent Communication with Autoencoders

  2021cites this paper
• Language is N ot A bout L anguage : Towards F ormalizing the R ole of Extra L inguistic F actors in H uman and M achine L anguage A cquisition and C ommunication

  2021cites this paper
• ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition

  2021cites this paper
• Intelligent Behavior Depends on the Ecological Niche

  2021cites this paper
• In-the-Moment Visual Information from the Infant's Egocentric View Determines the Success of Infant Word Learning: A Computational Study

  2021cites this paper
• Is there a bilingual disadvantage for word segmentation? A computational modeling approach

  2021cites this paper
• Visually grounded models of spoken language: A survey of datasets, architectures and evaluation techniques

  2021cites this paper
• Learning Actions From Natural Language Instructions Using an ON-World Embodied Cognitive Architecture

  2021cites this paper
• A Computational Model of Early Word Learning from the Infant's Point of View

  2020cites this paper
• Catplayinginthesnow: Impact of Prior Segmentation on a Model of Visually Grounded Speech

  2020cites this paper
• Crossmodal Language Grounding in an Embodied Neurocognitive Model

  2020cites this paper
• Learning to Associate Spoken Words and Visual Objects from Egocentric Video of Parent-infant Social Interaction

  2020cites this paper
• Spoken Language Interaction with Virtual Agents and Robots (SLIVAR): Towards Effective and Ethical Interaction (Dagstuhl Seminar 20021)

  2020cites this paper
• Quantization Games on Social Networks and Language Evolution

  2020cites this paper
• Robots That Use Language

  2020cites this paper
• Simulating Early Word Learning in Situated Connectionist Agents

  2020cites this paper
• A computational theory of child overextension.

  2020cites this paper
• Computational framework for fusing eye movements and spoken narratives for image annotation

  2020cites this paper
• Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog

  2020cites this paper
• Vokenization: Improving Language Understanding via Contextualized, Visually-Grounded Supervision

  2020cites this paper
• A computational model of early language acquisition from audiovisual experiences of young infants

  2019cites this paper
• Modeling the Co-Emergence of Linguistic Constructions and Action Concepts: The Case of Action Verbs

  2019cites this paper
• Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech

  2019cites this paper
• End-to-end automated cache-timing attack driven by machine learning

  2019cites this paper
• Development of 3D object’s geometrical properties based architecture for physical symbol grounding

  2019cites this paper
• Towards Bilingual Lexicon Discovery From Visually Grounded Speech Audio

  2019cites this paper
• Learning Words by Drawing Images

  2019cites this paper
• Towards Visually Grounded Sub-word Speech Unit Discovery

  2019cites this paper
• Neuro-SERKET: Development of Integrative Cognitive System Through the Composition of Deep Probabilistic Generative Models

  2019cites this paper
• Children's overextension as communication by multimodal chaining

  2019cites this paper
• Word Recognition, Competition, and Activation in a Model of Visually Grounded Speech

  2019influential citation
• Trends, Challenges and Adopted Strategies in RoboCup@Home

  2019cites this paper
• Goldilocks Forgetting in Cross-Situational Learning

  2018cites this paper
• Robots That Say “No” Affective Symbol Grounding and the Case of Intent Interpretations

  2018cites this paper
• Emergence of Communication in an Interactive World with Consistent Speakers

  2018cites this paper
• From Commands to Goal-based Dialogs: A Roadmap to Achieve Natural Language Interaction in RoboCup@Home

  2018cites this paper
• Extension of grounding mechanism for abstract words: computational methods insights

  2018cites this paper
• Association Learning inspired by the Symbol Grounding Problem

  2018cites this paper
• Visually grounded cross-lingual keyword spotting in speech

  2018cites this paper
• Recognition and Generation of Communicative Signals: Modeling of Hand Gestures, Speech Activity and Eye-Gaze in Human-Machine Interaction

  2018cites this paper
• Symbolic Inductive Bias for Visually Grounded Learning of Spoken Language

  2018cites this paper
• Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input

  2018cites this paper
• Learning Compositional Sparse Bimodal Models

  2018cites this paper
• Spreading in Social Systems: Reflections

  2018cites this paper
• Using EEG Emotion Models in Viewer Experience Design: An Exploratory Study

  2018cites this paper
• Unsupervised spatial lexical acquisition by updating a language model with place clues

  2018cites this paper
• Pragmatically Framed Cross-Situational Noun Learning Using Computational Reinforcement Models

  2018influential citation
• Bayesian Noisy Word Clustering through Sampling Prototypical Words

  2018cites this paper
• Accelerated Nonparametric Bayesian Double Articulation Analyzer for Unsupervised Word Discovery

  2018cites this paper
• Ensemble-of-Concept Models for Unsupervised Formation of Multiple Categories

  2018cites this paper
• Robots Learning to Say “No”

  2018cites this paper
• Comparison Studies on Active Cross-Situational Object-Word Learning Using Non-Negative Matrix Factorization and Latent Dirichlet Allocation

  2018cites this paper
• From Commands to Goal-based Dialogs : A Roadmap to Achieve Natural Language Interaction in RoboCup

  2018cites this paper
• Découverte non supervisée de lexique à partir d'un corpus multimodal pour la documentation des langues en danger

  2017influential citation
• Analysis of Audio-Visual Features for Unsupervised Speech Recognition

  2017cites this paper
• Improvement in Domain Specific Word Segmentation by Symbol Grounding

  2017cites this paper
• Understanding Grounded Language Learning Agents

  2017cites this paper
• Constructing a Language From Scratch: Combining Bottom–Up and Top–Down Learning Processes in a Computational Model of Language Acquisition

  2017cites this paper
• Self-Supervised Vision-Based Detection of the Active Speaker as Support for Socially Aware Language Acquisition

  2017cites this paper
• Visual-Linguistic Semantic Alignment: Fusing Human Gaze and Spoken Narratives for Image Region Annotation

  2017cites this paper
• Guiding Interaction Behaviors for Multi-modal Grounded Language Learning

  2017cites this paper
• Hopfield Net spreading activation for grounding of abstract action words in cognitive robot

  2017cites this paper
• Rapid development, real-world deployment, and evaluation of projected augmented reality applications

  2017cites this paper
• Understanding Early Word Learning in Situated Artificial Agents

  2017cites this paper
• Instructions for use Title A Method for Acquiring Body Movement Verbs for a Humanoid Robot through Physical Interactionwith Humans

  2017cites this paper
• SERKET: An Architecture for Connecting Stochastic Models to Realize a Large-Scale Cognitive Model

  2017cites this paper
• Bayesian models of category acquisition and meaning development

  2017cites this paper
• Computational models of tutor feedback in language acquisition

  2017cites this paper
• Comparative study of feature extraction methods for direct word discovery with NPB-DAA from natural speech signals

  2017cites this paper
• How Much of Language Acquisition Does Operant Conditioning Explain?

  2017cites this paper
• 第38回研究大会ワークショップ 理論研究再考―理論・モデルは社会言語科学にどう貢献するか?―

  2017cites this paper
• Interactive learning of words and objects for a humanoid robot. (Apprentissage interactif de mots et d'objets pour un robot humanoïde)

  2017influential citation