Evaluating Conversational Agents with Persona-driven User Simulations based on Large Language Models: A Sales Bot Case Study

,

• Publication year

  2025

• Venue

  Conference on Empirical Methods in Natural Language Processing

• Publication date

  Unknown publication date

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.18653/v1/2025.emnlp-industry.16
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Towards Personalized Conversational Sales Agents : Contextual User Profiling for Strategic Action

  2025cited by this paper
• OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personas

  2025influential reference
• Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization

  2024influential reference
• Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?

  2024influential reference
• Scaling Synthetic Data Creation with 1,000,000,000 Personas

  2024influential reference
• Judging LLM-as-a-judge with MT-Bench and Chatbot Arena

  2023influential reference
• Faithful Persona-based Conversational Dataset Generation with Large Language Models

  2023influential reference
• Developing persuasive systems for marketing: the interplay of persuasion techniques, customer traits and persuasive message design

  2023cited by this paper
• ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format

  2022cited by this paper
• Intraclass Correlation Coefficient (ICC)

  2021cited by this paper
• ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

  2020cited by this paper
• Mining Indecisiveness in Customer Behaviors

  2015cited by this paper
• The relationship among self-reported assertiveness, aggressiveness, gender role orientation, and self-concept in young men.

  2012cited by this paper
• Computing Krippendorff's Alpha-Reliability

  2011cited by this paper
• The roles of self-concept clarity and psychological reactance in compliance with product and service recommendations

  2010cited by this paper
• Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System

  2007cited by this paper
• User simulation for spoken dialogue systems: learning and evaluation

  2006cited by this paper
• Goal Seeker and Persuasion Sentry: How Consumer Targets Respond to Interpersonal Marketing Persuasion

  2004cited by this paper
• A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability

  2004influential reference
• A stochastic model of human-machine interaction for learning dialog strategies

  2000cited by this paper

• Build, Judge, Optimize: A Blueprint for Continuous Improvement of Multi-Agent Consumer Assistants

  2026cites this paper