BBN BYBLOS and HARC February 1992 ATIS Benchmark Results

We present results from the February '92 evaluation on the ATIS travel planning domain for HARC, the BBN spoken language system (SLS). In addition, we discuss in detail the individual performance of BYBLOS, the speech recognition (SPREC) component.In the official scoring, conducted by NIST, BBN's HARC system produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated.For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results were significantly better than any other speech system evaluated.

• Publication year

  1992

• Venue

  Human Language Technology - The Baltic Perspectiv

• Publication date

  1992-02-23

• Fields of study

  Computer Science

• Identifiers
  DOI 10.3115/1075527.1075544
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Fragment Processing in the DELPHI System

  1992cited by this paper
• Syntactic/Semantic Coupling in the BBN DELPHI System

  1992cited by this paper
• Multi-Site Data Collection for a Spoken Language Corpus

  1992cited by this paper
• BYBLOS Speech Recognition Benchmark Results

  1991cited by this paper
• Statistical Agenda Parsing

  1991cited by this paper
• Efficient, High-Performance Algorithms for N-Best Search

  1990cited by this paper
• The N-Best Algorithm: Efficient Procedure for Finding Top N Sentence Hypotheses

  1989cited by this paper
• Unification-Based Semantic Interpretation in the BBN Spoken Language System

  1989cited by this paper
• Estimation of probabilities from sparse data for the language model component of a speech recognizer

  1987cited by this paper

• Two New Challenging Resources to Evaluate Natural Language Interfaces to Databases Generated Based on Geobase and Geoquery

  2021cites this paper
• Analysis of Some Database Schemas Used to Evaluate Natural Language Interfaces to Databases

  2015cites this paper
• Improving the efficacy of automated sign language practice tools

  2007cites this paper
• A Bilingual VOYAGER System

  2005cites this paper
• Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear

  2002cites this paper
• Disfluency Rates in Conversation: Effects of Age, Relationship, Topic, Role, and Gender

  2001cites this paper
• D isfluency R ates in Conversation: Effects of A ge, R elationship, Topic, R ole, and G ender*

  2001cites this paper
• Design Issues for Interfaces using Voice Input

  1997cites this paper
• Multilingual spoken-language understanding in the MIT Voyager system

  1995cites this paper
• A Statistical Approach to Language Modelling for the ATIS Problem

  1995cites this paper
• Speechacts: A Testbed For Continuous Speech Applications

  1994cites this paper
• Combining Knowledge Sources to Reorder N-Best Speech Hypothesis Lists

  1994cites this paper
• On pattern, categories, and alternate realities

  1993cites this paper
• A bilingual Voyager system

  1993cites this paper
• The BBN/HARC spoken language understanding system

  1993cites this paper
• DARPA February 1992 ATIS Benchmark Test Results

  1992cites this paper
• An experiment in spoken language acquisition

  1992cites this paper
• Robust Continuous Speech Recognition

  1992cites this paper