Cheap, Fast and Good Enough: Automatic Speech Recognition with Non-Expert Transcription

No abstract is available for this paper.

• Publication year

  2010

• Venue

  North American Chapter of the Association for Computational Linguistics

• Publication date

  2010-06-02

• Fields of study

  Linguistics, Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Using the Amazon Mechanical Turk for transcription of spoken language

  2010cited by this paper
• Fast transcription of unstructured audio recordings

  2009cited by this paper
• Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon’s Mechanical Turk

  2009cited by this paper
• A self-labeling speech corpus: collecting spoken words with an online educational game

  2009cited by this paper
• Feasibility of Human-in-the-loop Minimum Error Rate Training

  2009cited by this paper
• Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks

  2008influential reference
• Unsupervised versus supervised training of acoustic models

  2008cited by this paper
• Rapid and accurate spoken term detection

  2007cited by this paper
• The Hidden Information State Approach to Dialog Management

  2007cited by this paper
• The 2004 BBN/LIMSI 20xRT English conversational telephone speech recognition system

  2005cited by this paper
• Using quick transcriptions to improve conversational speech models

  2004cited by this paper
• The Fisher Corpus: a Resource for the Next Generations of Speech-to-Text

  2004cited by this paper
• Getting More Mileage from Web Text Sources for Conversational Speech Language Modeling using Class-Dependent Mixtures

  2003cited by this paper
• Lightly supervised and unsupervised acoustic model training

  2002cited by this paper
• Automatic Segmentation of Words using Syllable Bigram Statistics

  2001cited by this paper
• Lightly Supervised Acoustic Model Training

  2000cited by this paper
• A post-processing system to yield reduced word error rates: Recognizer Output Voting Error Reduction (ROVER)

  1997cited by this paper
• Application of large vocabulary continuous speech recognition to topic and speaker identification using telephone speech

  1993influential reference
• SWITCHBOARD: telephone speech corpus for research and development

  1992cited by this paper
• Computer Speech and Language

  1986cited by this paper

• Building an Accurate Open-Source Hebrew ASR System through Crowdsourcing

  2025cites this paper
• Benchmarking Cloud-based Speech-to-Text APIs for Multilingual Meetings: A Comparative Study on English, Thai, and Malay

  2025cites this paper
• From Weak Labels to Strong Results: Utilizing 5,000 Hours of Noisy Classroom Transcripts with Minimal Accurate Data

  2025cites this paper
• Better Semi-supervised Learning for Multi-domain ASR Through Incremental Retraining and Data Filtering

  2025cites this paper
• Initial decoding with minimally augmented language model for improved lattice rescoring in low resource ASR

  2024cites this paper
• Speech Foundation Models and Crowdsourcing for Efficient, High-Quality Data Collection

  2024cites this paper
• Crowdsourced Data Validation for ASR Training

  2023cites this paper
• Automation of Language Sample Analysis

  2023cites this paper
• Human Transcription Quality Improvement

  2023cites this paper
• Dynamic Unknown Worker Recruitment for Heterogeneous Contextual Labeling Tasks Using Adversarial Multi-Armed Bandit

  2022cites this paper
• Quantifying Language Variation Acoustically with Few Resources

  2022cites this paper
• GailBot: An automatic transcription system for Conversation Analysis

  2022influential citation
• SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesis

  2022cites this paper
• Crowdsourcing Formulaic

  2022cites this paper
• Eliciting Thinking Hierarchy without a Prior

  2021cites this paper
• Advanced Data Expoitation in Speech Analysis

  2021cites this paper
• CrowdSpeech and Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription

  2021cites this paper
• Identifying Fast/Slow Thinking without Prior

  2021cites this paper
• Truth Discovery in Sequence Labels from Crowds

  2021cites this paper
• Vox Populi, Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription

  2021influential citation
• Deep learning for post‐hurricane aerial damage assessment of buildings

  2021cites this paper
• Studying Programmer Behaviour at Scale: A Case Study using Amazon Mechanical Turk

  2021cites this paper
• HarperValleyBank: A Domain-Specific Spoken Dialog Corpus

  2020cites this paper
• A Crowdsourced Open-Source Kazakh Speech Corpus and Initial Speech Recognition Baseline

  2020cites this paper
• Semi-supervised learning for acoustic model retraining: Handling speech data with noisy transcript

  2020cites this paper
• Building Low-Resource NER Models Using Non-Speaker Annotations

  2020cites this paper
• The Only (Other) Poll That Matters? Exit Polls and Election Night Forecasts in BBC General Election Results Broadcasts, 1955–2017

  2020cites this paper
• A New Acoustic-Based Pronunciation Distance Measure

  2020cites this paper
• Crowdsourcing formulaic phrases: towards a new type of spoken corpus

  2020cites this paper
• Neural representations for modeling variation in speech

  2020cites this paper
• Speaking Outside the Box: Exploring the Benefits of Unconstrained Input in Crowdsourcing and Citizen Science Platforms

  2020cites this paper
• Measuring foreign accent strength using an acoustic distance measure

  2020cites this paper
• Building a Speech and Text Corpus of Turkish: Large Corpus Collection with Initial Speech Recognition Results

  2020cites this paper
• Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers

  2020cites this paper
• Neural Representations for Modeling Variation in English Speech

  2020cites this paper
• Unsupervised Adaptation of Question Answering Systems via Generative Self-training

  2020cites this paper
• Probabilistic models for aggregating crowdsourced annotations

  2019cites this paper
• The Lacunae of Danish Natural Language Processing

  2019cites this paper
• On the evaluation and selection of classifier learning algorithms with crowdsourced data

  2019cites this paper
• Detecting Mismatch Between Speech and Transcription Using Cross-Modal Attention

  2019cites this paper
• Truth Inference at Scale: A Bayesian Model for Adjudicating Highly Redundant Crowd Annotations

  2019cites this paper
• Exploiting Sound Masking for Audio Privacy in Smartphones

  2019cites this paper
• Please Clap: Modeling Applause in Campaign Speeches

  2018cites this paper
• Trustability-Based Dynamic Active Learning for Crowdsourced Labelling of Emotional Audio Data

  2018cites this paper
• Crowdsourcing

  2018cites this paper
• Multi-dialect Arabic broadcast speech recognition

  2018cites this paper
• Annotator Trustability-based Cooperative Learning Solutions for Intelligent Audio Analysis

  2018cites this paper
• A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature

  2018cites this paper
• Digitally Speaking: Multitasking and the Future of Digital Language for Academic Communication

  2018cites this paper
• Using Social Media for Biomonitoring: How Facebook, Twitter, Flickr and Other Social Networking Platforms Can Provide Large-Scale Biodiversity Data

  2018cites this paper
• Administrative Delay, Red Tape, and Organizational Performance

  2018cites this paper
• Crowd Coach

  2018influential citation
• On-the-job Learning for Real-time

  2017cites this paper
• The Opportunities and Limitations of Using Mechanical Turk (MTURK) in Public Administration and Management Scholarship

  2017cites this paper
• Crowdsourcing Speech and Language Data for Resource-Poor Languages

  2017cites this paper
• Scopist: Building a Skill Ladder into Crowd Transcription

  2017influential citation
• Collecting fluency corrections for spoken learner English

  2017cites this paper
• Comparing human and machine recognition of children’s touchscreen stroke gestures

  2017cites this paper
• Advanced Data Exploitation in Speech Analysis: An overview

  2017cites this paper
• Leveraging Complementary Contributions of Different Workers for Efficient Crowdsourcing of Video Captions

  2017cites this paper
• The CorCenCC crowdsourcing app: a bespoke tool for the user-driven creation of the national corpus of contemporary Welsh

  2017cites this paper
• Annotator Expertise and Information Quality in Annotation-based Retrieval

  2017cites this paper
• Decomposability and the Effects of Morpheme Frequency in Lexical Access

  2016cites this paper
• Performance Improvements of Probabilistic Transcript-adapted ASR with Recurrent Neural Network and Language-specific Constraints

  2016cites this paper
• Vapor Engine: Demonstrating an Early Prototype of a Language-Independent Search Engine for Speech

  2016cites this paper
• Adapting ASR for under-resourced languages using mismatched transcriptions

  2016cites this paper
• An examination of the language construct in NIMH's research domain criteria: Time for reconceptualization!

  2016cites this paper
• Two-Stage Data Augmentation for Low-Resourced Speech Recognition

  2016cites this paper
• Manipulating Word Lattices to Incorporate Human Corrections

  2016cites this paper
• Creating a ground truth multilingual dataset of news and talk show transcriptions through crowdsourcing

  2016cites this paper
• Optimizing Computer-Assisted Transcription Quality with Iterative User Interfaces

  2016influential citation
• On Employing a Highly Mismatched Crowd for Speech Transcription

  2016cites this paper
• Getting more from automatic transcripts for semi-supervised language modeling

  2016cites this paper
• On gamifying the transcription of digital video lectures

  2016cites this paper
• Danish Stød and Automatic Speech Recognition

  2016cites this paper
• Performance Improvement of Probabilistic Transcriptions with Language-specific Constraints

  2016cites this paper
• Cost Optimization in Crowdsourcing Translation: Low cost translations made even cheaper

  2015cites this paper
• UMEME: University of Michigan Emotional McGurk Effect Data Set

  2015cites this paper
• Best Practices for Crowdsourcing Dialectal Arabic Speech Transcription

  2015influential citation
• Using keyword spotting to help humans correct captioning faster

  2015cites this paper
• Automatic transcription and phonetic labelling of dyslexic children's reading in Bahasa Melayu

  2015cites this paper
• Crowdsourcing construction of information retrieval test collections for conversational speech

  2015cites this paper
• Acquiring Speech Transcriptions Using Mismatched Crowdsourcing

  2015cites this paper
• Models of dataset size, question design, and cross-language speech perception for speech crowdsourcing applications

  2015cites this paper
• Transcribing continuous speech using mismatched crowdsourcing

  2015cites this paper
• Klejch Development of a cloud platform for automatic speech recognition

  2015cites this paper
• Experts ou (foule de) non-experts ? la question de l’expertise des annotateurs vue de la myriadisation (crowdsourcing)

  2015cites this paper
• Crowdsource a little to label a lot: labeling a speech corpus of dialectal Arabic

  2015cites this paper
• Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms

  2015cites this paper
• Conversational Arabic Automatic Speech Recognition

  2015cites this paper
• Exploiting resources from closely-related languages for automatic speech recognition in low-resource languages from Malaysia. (Utilisation de ressources dans une langue proche pour la reconnaissance automatique de la parole pour les langues peu dotées de Malaisie)

  2015cites this paper
• Temporal modeling of crowd work quality for quality assurance in crowdsourcing

  2015cites this paper
• Harnessing Collective Intelligence on Social Networks

  2015cites this paper
• Improving multiple-crowd-sourced transcriptions using a speech recogniser

  2015cites this paper
• Robustness in speech quality assessment and temporal training expiry in mobile crowdsourcing environments

  2015cites this paper
• Intelligibility of synthetic speech in noise and reverberation

  2015cites this paper
• G2PIL: A GRAPHEME-TO-PHONEME CONVERSION TOOL FOR THE ITALIAN LANGUAGE

  2015cites this paper
• Matching and Grokking: Approaches to Personalized Crowdsourcing

  2015cites this paper
• An outlier filtering approach for machine sourced weak segmentations

  2015cites this paper
• Translations of the Callhome Egyptian Arabic corpus for conversational speech translation

  2014cites this paper