A Neural Network Approach to Context-Sensitive Generation of Conversational Responses

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual information into classic statistical models, allowing the system to take into account previous dialog utterances. Our dynamic-context generative models show consistent gains over both context-sensitive and non-context-sensitive Machine Translation and Information Retrieval baselines.

• Publication year

  2015

• Venue

  North American Chapter of the Association for Computational Linguistics

• Publication date

  2015-06-22

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.3115/v1/N15-1020arXiv 1506.06714
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Fast and Robust Neural Network Joint Models for Statistical Machine Translation

  2014cited by this paper
• Sequence to Sequence Learning with Neural Networks

  2014cited by this paper
• A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval

  2014cited by this paper
• Modeling Interestingness with Deep Neural Networks

  2014influential reference
• Natural Language Generation in Interactive Systems

  2014cited by this paper
• Learning Continuous Phrase Representations for Translation Modeling

  2014influential reference
• Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

  2014cited by this paper
• Recurrent Continuous Translation Models

  2013cited by this paper
• Learning deep structured semantic models for web search using clickthrough data

  2013cited by this paper
• Joint Language and Translation Modeling with Recurrent Neural Networks

  2013cited by this paper
• Context dependent recurrent neural network language model

  2012cited by this paper
• On the difficulty of training recurrent neural networks

  2012cited by this paper
• Adaptive Subgradient Methods for Online Learning and Stochastic Optimization

  2011cited by this paper
• Data-Driven Response Generation in Social Media

  2011influential reference
• Recurrent neural network based language model

  2010influential reference
• The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management

  2010cited by this paper
• Noise-contrastive estimation: A new estimation principle for unnormalized statistical models

  2010cited by this paper
• A unified architecture for natural language processing: deep neural networks with multitask learning

  2008cited by this paper
• Moses: Open Source Toolkit for Statistical Machine Translation

  2007cited by this paper
• User simulation for spoken dialogue systems: learning and evaluation

  2006cited by this paper
• METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments

  2005influential reference
• The Alignment Template Approach to Statistical Machine Translation

  2004cited by this paper
• A Neural Probabilistic Language Model

  2003cited by this paper
• Minimum Error Rate Training in Statistical Machine Translation

  2003cited by this paper
• A trainable generator for recommendations in multimodal dialog

  2003cited by this paper
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002influential reference
• Talking to machines (statistically speaking)

  2002cited by this paper
• GatfordCentre for Interactive Systems ResearchDepartment of Information

  1996cited by this paper
• Improved backing-off for M-gram language modeling

  1995cited by this paper
• Learning representations by back-propagating errors

  1986cited by this paper

• OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios

  2025influential citation
• NusaDialogue: Dialogue Summarization and Generation for Underrepresented and Extremely Low-Resource Languages

  2025cites this paper
• Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey

  2025cites this paper
• Outside Knowledge Conversational Video (OKCV) Dataset - Dialoguing over Videos

  2025cites this paper
• A State-Update Prompting Strategy for Efficient and Robust Multi-turn Dialogue

  2025cites this paper
• D3QE: Learning Discrete Distribution Discrepancy-aware Quantization Error for Autoregressive-Generated Image Detection

  2025cites this paper
• A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

  2024cites this paper
• SCAINs Presenter: Preventing Miscommunication by Detecting Context-Dependent Utterances in Spoken Dialogue

  2024cites this paper
• Building Better AI Agents: A Provocation on the Utilisation of Persona in LLM-based Conversational Agents

  2024cites this paper
• Mix-Initiative Response Generation with Dynamic Prefix Tuning

  2024cites this paper
• Position-based focal loss for diverse and relevant response generation

  2024cites this paper
• Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization

  2024cites this paper
• FluGCF: A Fluent Dialogue Generation Model With Coherent Concept Entity Flow

  2024cites this paper
• GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency

  2024cites this paper
• A multi-perspective global–local interaction framework for identifying dialogue acts and sentiments of dialogue utterances jointly

  2023cites this paper
• TikTalk: A Multi-Modal Dialogue Dataset for Real-World Chitchat

  2023cites this paper
• SoK: The Ghost Trilemma

  2023cites this paper
• Chatbots to ChatGPT in a Cybersecurity Space: Evolution, Vulnerabilities, Attacks, Challenges, and Future Recommendations

  2023cites this paper
• XDailyDialog: A Multilingual Parallel Dialogue Corpus

  2023cites this paper
• Knowledge Interpolated Conditional Variational Auto-Encoder for Knowledge Grounded Dialogues

  2023cites this paper
• Static Fuzzy Bag-of-Words: a lightweight sentence embedding algorithm

  2023cites this paper
• Evaluation of effectiveness in conversations between humans and chatbots using parallel convolutional neural networks with multiple temporal resolutions

  2023cites this paper
• A Primer on Seq2Seq Models for Generative Chatbots

  2023cites this paper
• Free-form Conversation with Human and Symbolic Avatars in Mixed Reality

  2023cites this paper
• When large language models meet personalization: perspectives of challenges and opportunities

  2023cites this paper
• Question Generation to Elicit Users’ Food Preferences Considering the Semantic Content

  2023cites this paper
• Rewarding Chatbots for Real-World Engagement with Millions of Users

  2023cites this paper
• Generative AI in Management – Today and Tomorrow

  2023cites this paper
• Virtual Customer Assistants in finance: From state of the art and practices to design guidelines

  2023cites this paper
• Chatbots & Dialogue Systems

  2023cites this paper
• A Unified Framework for Slot based Response Generation in a Multimodal Dialogue System

  2023cites this paper
• Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation

  2023cites this paper
• Use of a Taxonomy of Empathetic Response Intents to Control and Interpret Empathy in Neural Chatbots

  2023influential citation
• Envisioning Future from the Past: Hierarchical Duality Learning for Multi-Turn Dialogue Generation

  2023cites this paper
• A Review of AI-Driven Conversational Chatbots Implementation Methodologies and Challenges (1999–2022)

  2023cites this paper
• Information-Enhanced Hierarchical Self-Attention Network for Multiturn Dialog Generation

  2023influential citation
• Learning a Structural Causal Model for Intuition Reasoning in Conversation

  2023cites this paper
• Let's Get Personal: Personal Questions Improve SocialBot Performance in the Alexa Prize

  2023cites this paper
• A Survey of Personality, Persona, and Profile in Conversational Agents and Chatbots

  2023cites this paper
• You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona

  2023cites this paper
• Automatic Dialog Flow Extraction and Guidance

  2023cites this paper
• Open Domain Response Generation Guided by Retrieved Conversations

  2023cites this paper
• TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World

  2023cites this paper
• Exploring Bi-Directional Context for Improved Chatbot Response Generation Using Deep Reinforcement Learning

  2023cites this paper
• Artificial Intelligence Based Chatbot for Healthcare Applications

  2023cites this paper
• Heterogeneous-Branch Collaborative Learning for Dialogue Generation

  2023cites this paper
• Sentiment Aided Graph Attentive Contextualization for Task Oriented Negotiation Dialogue Generation

  2023cites this paper
• Unleashing the Potential of Conversational AI: Amplifying Chat-GPT’s Capabilities and Tackling Technical Hurdles

  2023cites this paper
• Enhancing Conversational Model With Deep Reinforcement Learning and Adversarial Learning

  2023cites this paper
• On the Underspecification of Situations in Open-domain Conversational Datasets

  2023cites this paper
• SmartProbe: A Virtual Moderator for Market Research Surveys

  2023cites this paper
• Delving into Global Dialogue Structures: Structure Planning Augmented Response Selection for Multi-turn Conversations

  2023cites this paper
• Lost in Dialogue: A Review and Categorisation of Current Dialogue System Approaches and Technical Solutions

  2023cites this paper
• Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes

  2023cites this paper
• EmoKbGAN: Emotion controlled response generation using Generative Adversarial Network for knowledge grounded conversation

  2023cites this paper
• Multimodal Conversational AI: A Survey of Datasets and Approaches

  2022cites this paper
• End-to-End Dialogue Generation Using a Single Encoder and a Decoder Cascade With a Multidimension Attention Mechanism

  2022influential citation
• Learning towards conversational AI: A survey

  2022influential citation
• What Did You Say? Task-Oriented Dialog Datasets Are Not Conversational!?

  2022cites this paper
• A Randomized Link Transformer for Diverse Open-Domain Dialogue Generation

  2022cites this paper
• Evaluating Dialogue Response Generation Systems via Response Selection with Well-chosen False Candidates

  2022cites this paper
• TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge

  2022cites this paper
• CASA: Conversational Aspect Sentiment Analysis for Dialogue Understanding

  2022cites this paper
• Discourse means for maintaining a proper rhetorical flow

  2022cites this paper
• Generating Relevant and Informative uestions for Open-domain Conversations ∗

  2022cites this paper
• Do You Ever Get Off Track in a Conversation? The Conversational System’s Anatomy and Evaluation Metrics

  2022cites this paper
• LaMDA: Language Models for Dialog Applications

  2022cites this paper
• Human–Machine Multi-Turn Language Dialogue Interaction Based on Deep Learning

  2022cites this paper
• Improve the Response Diversity of Multi-turn Dialogue System by Combining Knowledge

  2022cites this paper
• DialoGen: Generalized Long-Range Context Representation for Dialogue Systems

  2022cites this paper
• Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems

  2022cites this paper
• Incorporating Causal Analysis into Diversified and Logical Response Generation

  2022cites this paper
• State of the Art of User Simulation approaches for conversational information retrieval

  2022cites this paper
• JDDC 2.1: A Multimodal Chinese Dialogue Dataset with Joint Tasks of Query Rewriting, Response Generation, Discourse Parsing, and Summarization

  2022influential citation
• Response Sentence Modification Using a Sentence Vector for a Flexible Response Generation of Retrieval-based Dialogue Systems

  2022cites this paper
• Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder

  2022cites this paper
• Improving a sequence-to-sequence nlp model using a reinforcement learning policy algorithm

  2022cites this paper
• Towards Generalized and Explainable Long-Range Context Representation for Dialogue Systems

  2022cites this paper
• Semantic Content Prediction for Generating Interviewing Dialogues to Elicit Users’ Food Preferences

  2022cites this paper
• Deploying a Retrieval based Response Model for Task Oriented Dialogues

  2022cites this paper
• Measuring and Narrowing the Compositionality Gap in Language Models

  2022cites this paper
• A study of interactive robot architecture through the practical implementation of conversational android

  2022cites this paper
• MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation

  2022cites this paper
• PEDM: A Multi-task Learning Model for Persona-aware Emoji-embedded Dialogue Generation

  2022cites this paper
• Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables

  2022cites this paper
• CausalDialogue: Modeling Utterance-level Causality in Conversations

  2022cites this paper
• Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems

  2022cites this paper
• Context-aware multi-feature fusion for open-domain dialogue generation

  2022cites this paper
• The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding

  2022cites this paper
• Joint Learning of Practical Dialogue Systems and User Simulators

  2022cites this paper
• Incorporating Casual Analysis into Diversified and Logical Response Generation

  2022cites this paper
• A New Entity-relation Joint Extraction Model using Reinforcement Learning and Its Application Test

  2022cites this paper
• N-best Response-based Analysis of Contradiction-awareness in Neural Response Generation Models

  2022cites this paper
• A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation

  2022cites this paper
• Prompting for a conversation: How to control a dialog model?

  2022cites this paper
• Counterfactual Decoding for Anti-Hallucination Knowledge-grounded Dialogue Generation

  2022cites this paper
• Autonomous Generation of Service Strategy for Household Tasks: A Progressive Learning Method With A Priori Knowledge and Reinforcement Learning

  2022cites this paper
• RT-KGD: Relation Transition Aware Knowledge-Grounded Dialogue Generation

  2022cites this paper
• SAM: Multi-turn Response Selection Based on Semantic Awareness Matching

  2022cites this paper
• OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

  2022cites this paper