Interaction Quality: Assessing the quality of ongoing spoken dialog interaction by experts - And how it relates to user satisfaction

No abstract is available for this paper.

• Publication year

  2015

• Venue

  Speech Communication

• Publication date

  2015-11-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1016/j.specom.2015.06.003
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The proof and measurement of association between two things.

  2015cited by this paper
• Data Mining Practical Machine Learning Tools and Techniques

  2014cited by this paper
• Dialogue Management for User-Centered Adaptive Dialogue

  2014cited by this paper
• First Insight into Quality-Adaptive Dialogue

  2014cited by this paper
• The Dialog State Tracking Challenge

  2013cited by this paper
• On Quality Ratings for Spoken Dialogue Systems – Experts vs. Users

  2013influential reference
• Metrics and Evaluation of Spoken Dialogue Systems

  2012cited by this paper
• EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability

  2012cited by this paper
• A Parameterized and Annotated Spoken Dialog Corpus of the CMU Let’s Go Bus Information System

  2012cited by this paper
• Towards Quality-Adaptive Spoken Dialogue Management

  2012cited by this paper
• Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop

  2011cited by this paper
• Modeling and Predicting Quality in Spoken Human-Computer Interaction

  2011cited by this paper
• Anger recognition in speech using acoustic and linguistic cues

  2011cited by this paper
• Automatically Training a Problematic Dialogue Predictor for a Spoken Dialogue System

  2011cited by this paper
• A Theoretical Framework for a User-Centered Spoken Dialog Manager

  2011cited by this paper
• Advances in Speech Recognition: Mobile Environments, Call Centers and Clinics

  2010cited by this paper
• Issues in Predicting User Satisfaction Transitions in Dialogues: Individual Differences, Evaluation Criteria, and Prediction Models

  2010influential reference
• Estimation Method of User Satisfaction Using N-gram-based Dialog History Model for Spoken Dialog System

  2010influential reference
• Facing Reality: Simulating Deployment of Anger Recognition in IVR Systems

  2010cited by this paper
• Is it possible to predict task completion in automated troubleshooters?

  2010cited by this paper
• Repair strategies on trial: which error recovery do users like best?

  2010cited by this paper
• “For Heaven’s Sake, Gimme a Live Person!” Designing Emotion-Detection Customer Care Voice Applications in Automated Call Centers

  2010cited by this paper
• Modeling User Satisfaction Transitions in Dialogues from Overall Ratings

  2010influential reference
• On NoMatchs, NoInputs and BargeIns: Do Non-Acoustic Features Support Anger Detection?

  2009cited by this paper
• A taxonomy of quality of service and Quality of Experience of multimodal human-machine interaction

  2009cited by this paper
• Modeling User Satisfaction with Hidden Markov Models

  2009influential reference
• The Spoken Dialogue Challenge

  2009influential reference
• Perception in multimodal dialogue systems : 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT 2008, Kloster Irsee, Germany, June 16-18, 2008 : proceedings

  2008cited by this paper
• Automatic detection of learner’s affect from conversational cues

  2008cited by this paper
• Caller Experience: A method for evaluating dialog systems and its automatic prediction

  2008influential reference
• Weighting the Coefficients in PARADISE Models to Increase Their Generalizability

  2008cited by this paper
• When calls go wrong: how to detect problematic calls based on log-files and emotions?

  2008cited by this paper
• Detecting Problematic Dialogs with Automated Agents

  2008cited by this paper
• Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems

  2008influential reference
• Predicting the quality and usability of spoken dialogue services

  2008cited by this paper
• Online call quality monitoring for automating agent-based call centers

  2007cited by this paper
• Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users

  2007cited by this paper
• VALUE-BASED OPTIMAL DECISION FOR DIALOG SYSTEMS

  2006cited by this paper
• Evaluation of a spoken dialogue system with usability tests and long-term pilot studies: similarities and differences

  2006influential reference
• Squibs: The PARADISE Evaluation Framework: Issues and Findings

  2006cited by this paper
• Data mining - practical machine learning tools and techniques, Second Edition

  2005cited by this paper
• Quality of Telephone-Based Spoken Dialogue Systems

  2005influential reference
• Neue ITU-T-Empfehlungen zur Evaluierung telefonbasierter Sprachdialogdienste

  2005influential reference
• Quality of Telephone-Based Spoken Dialogue Systems

  2004cited by this paper
• Non-Native Users in the Let’s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch

  2004cited by this paper
• Optimizing Automated Call Routing by Integrating Spoken Dialog Models with Queuing Models

  2004cited by this paper
• What is this evasive beast we call user satisfaction?

  2003cited by this paper
• Designing and Evaluating an Adaptive Spoken Dialogue System

  2002cited by this paper
• What’s the Trouble: Automatically Identifying Problematic Dialogues in DARPA Communicator Dialogue Systems

  2002cited by this paper
• A stochastic model of human-machine interaction for learning dialog strategies

  2000cited by this paper
• Towards developing general models of usability with PARADISE

  2000cited by this paper
• Predicting Automatic Speech Recognition Performance Using Prosodic Cues

  2000cited by this paper
• The Nature of Statistical Learning Theory

  2000cited by this paper
• Stochastic language adaptation over time and state in natural spoken dialog systems

  2000cited by this paper
• Automatic Detection of Poor Speech Recognition at the Dialogue Level

  1999cited by this paper
• AUTOMATIC PREDICTION OF PROBLEMATIC HUMAN-COMPUTER DIALO GUES IN 'HOW MAY I HELP YOU?

  1999cited by this paper
• Empirically Evaluating an Adaptable Spoken Dialogue System

  1999cited by this paper
• Evaluating spoken dialogue agents with PARADISE: Two case studies

  1998cited by this paper
• From novice to expert: the effect of tutorials on user expertise with spoken dialogue systems

  1998cited by this paper
• Chapter 33 – From Novice to expert

  1997influential reference
• PARADISE: A Framework for Evaluating Spoken Dialogue Agents

  1997cited by this paper
• Data mining

  1997cited by this paper
• Assessing Agreement on Classification Tasks: The Kappa Statistic

  1996cited by this paper
• The measurement of end-user computing satisfaction: theoretical and methodological issues

  1991influential reference
• The measurement of user information satisfaction

  1983cited by this paper
• PERCEIVED USEFULNESS OF INFORMATION: A PSYCHOMETRIC EXAMINATION*

  1980cited by this paper
• What's the Trouble?

  1979cited by this paper
• The measurement of observer agreement for categorical data.

  1977cited by this paper
• Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.

  1968cited by this paper
• On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other

  1947cited by this paper
• Individual Comparisons by Ranking Methods

  1945cited by this paper

• ATOD: An Evaluation Framework and Benchmark for Agentic Task-Oriented Dialogue Systems

  2026cites this paper
• Generative AI and sustainable consumption: assessing cognitive and motivational drivers of trust through the elaboration likelihood model and expectancy–value theory

  2026cites this paper
• Fast Multi-Party Open-Ended Conversation with a Social Robot

  2025cites this paper
• LLM-guided Plan and Retrieval: A Strategic Alignment for Interpretable User Satisfaction Estimation in Dialogue

  2025cites this paper
• Beyond the Like Button: Deriving User Feedback with Rubrics and Metrics in Virtual Assistants

  2025cites this paper
• To Adopt or Not to Adopt: Configurations for GenAI Recommendation Adoption in Sustainable Consumer Behavior

  2025cites this paper
• Influence of Personality Traits and Demographics on Rapport Recognition Using Adversarial Learning

  2025cites this paper
• Phonetic reduction is associated with positive assessment and other pragmatic functions

  2025cites this paper
• Exploring the drivers of AI-seeking intention among AI community canteen customers

  2024cites this paper
• Comparing Pre-Trained Embeddings and Domain-Independent Features for Regression-Based Evaluation of Task-Oriented Dialogue Systems

  2024cites this paper
• Continuous intention usage of artificial intelligence enabled digital banks: a review of expectation confirmation model

  2024cites this paper
• Combining statistical dialog management and intent recognition for enhanced response selection

  2024cites this paper
• Human-Robot Interaction Conversational User Enjoyment Scale (HRI CUES)

  2024cites this paper
• Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems

  2024cites this paper
• Interpretable User Satisfaction Estimation for Conversational Systems with Large Language Models

  2024cites this paper
• Dialogue Quality and Emotion Annotations for Customer Support Conversations

  2023cites this paper
• Predicting Interaction Quality of Conversational Assistants With Spoken Language Understanding Model Confidences

  2023influential citation
• Toward More Accurate and Generalizable Evaluation Metrics for Task-Oriented Dialogs

  2023cites this paper
• EmoUS: Simulating User Emotions in Task-Oriented Dialogues

  2023cites this paper
• Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents

  2022cites this paper
• Joint Goal Segmentation and Goal Success Prediction on Multi-Domain Conversations

  2022influential citation
• Simulating Inconsistencies in Task-oriented Dialog

  2022cites this paper
• Joint Learning of Practical Dialogue Systems and User Simulators

  2022cites this paper
• FPI: Failure Point Isolation in Large-scale Conversational Assistants

  2022cites this paper
• Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems

  2021cites this paper
• Customer Engagement and Participation Behavior: The Underlying Mechanisms of the Virtual Servicescape and Service Outcomes

  2021cites this paper
• User Satisfaction Reward Estimation Across Domains: Domain-independent Dialogue Policy Learning

  2021influential citation
• Multimodal User Satisfaction Recognition for Non-task Oriented Dialogue Systems

  2021cites this paper
• Actionable conversational quality indicators for improving task-oriented dialog systems

  2021influential citation
• Search based Self-Learning Query Rewrite System in Conversational AI

  2021cites this paper
• RoBERTaIQ: An Efficient Framework for Automatic Interaction Quality Estimation of Dialogue Systems

  2021cites this paper
• Is the User Enjoying the Conversation? A Case Study on the Impact on the Reward Function

  2021cites this paper
• Human-AI Interactions Through A Gricean Lens

  2021cites this paper
• Blending Task Success and User Satisfaction: Analysis of Learned Dialogue Behaviour with Multiple Rewards

  2021influential citation
• Conversational AI: Dialogue Systems, Conversational Agents, and Chatbots

  2020cites this paper
• Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation

  2020cites this paper
• Similarity Scoring for Dialogue Behaviour Comparison

  2020cites this paper
• Voice Interaction for Training: Opportunities, Challenges, and Recommendations from HCI Perspective

  2020cites this paper
• IQ-Net: A DNN Model for Estimating Interaction-level Dialogue Quality with Conversational Agents

  2020influential citation
• Spot the Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems

  2020cites this paper
• Joint Turn and Dialogue level User Satisfaction Estimation on Mulit-Domain Conversations

  2020cites this paper
• Efficient Evaluation of Task Oriented Dialogue Systems

  2020cites this paper
• Survey on evaluation methods for dialogue systems

  2019cites this paper
• Scoring Interactional Aspects of Human-Machine Dialog for Language Learning and Assessment using Text Features

  2019cites this paper
• Planning for a Corpus of Continuous Ratings of Spoken Dialog Quality

  2019influential citation
• Towards a Metric for Automated Conversational Dialogue System Evaluation and Improvement

  2019cites this paper
• QoE Modeling for Voice over IP: Simplified E-model Enhancement Utilizing the Subjective MOS Prediction Model: A Case of G.729 and Thai Users

  2019cites this paper
• Improving Interaction Quality Estimation with BiLSTMs and the Impact on Dialogue Policy Learning

  2019influential citation
• Increasing the Role of Data Analytics in m-Learning Conversational Applications

  2018cites this paper
• On the Applicability of a User Satisfaction-Based Reward for Dialogue Policy Learning

  2018cites this paper
• Predicting Interaction Quality in Customer Service Dialogs

  2018cites this paper
• Explorer Predicting Group Satisfaction in Meeting Discussions

  2018cites this paper
• Predicting group satisfaction in meeting discussions

  2018cites this paper
• Domain-Independent User Satisfaction Reward Estimation for Dialogue Policy Learning

  2017cites this paper
• Modeling continuance intention towards Mobile Travel Service System (MTSS): a theoretical perspective of motivation and dependency

  2017cites this paper
• Analysis of Overlapping Speech and Emotions for Interaction Quality Estimation

  2017cites this paper
• Significance of Interaction Parameter Levels in Interaction Quality Modelling for Human-Human Conversation

  2017cites this paper
• Interaction Quality Estimation Using Long Short-Term Memories

  2017cites this paper
• Could Emotions Be Beneficial for Interaction Quality Modelling in Human-Human Conversations?

  2017influential citation
• Sympathy Begins with a Smile, Intelligence Begins with a Word: Use of Multimodal Features in Spoken Human-Robot Interaction

  2017cites this paper
• Analysis of Interaction Parameter Levels in Interaction Quality Modelling for Human-Human Conversation

  2017cites this paper
• Predicting Causes of Reformulation in Intelligent Assistants

  2017cites this paper
• Belief Tracking Interaction Quality Reward Estimation Semantic Decoding Speech Recognition Speech Synthesis Language Generation Environment

  2017cites this paper
• A framework for improving error detection and correction in spoken dialog systems

  2016cites this paper
• Interaction Quality as a Human-Human Task-Oriented Conversation Performance

  2016cites this paper
• Analysis of Temporal Features for Interaction Quality Estimation

  2016cites this paper
• First Experiments on Interaction Quality Modelling for Human-Human Conversation

  2016cites this paper
• Recurrent Neural Network Interaction Quality Estimation

  2016influential citation
• Evaluating the Conversational Interface

  2016cites this paper
• Emotion, Affect, and Personality

  2016cites this paper
• Quality-adaptive Spoken Dialogue Initiative Selection And Implications On Reward Modelling

  2015cites this paper
• User-centred adaptive spoken dialogue modelling

  2015cites this paper
• 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue

  2014cites this paper
• Proceedings of the Annual Meeting of the Cognitive Science Society

  year unknowncites this paper
• Some Pragmatic Functions of Phonetic Reduction

  year unknowncites this paper