Mind Mapper: Modeling and Predicting Behavioral Patterns from Everyday Conversations with Wearable AI Systems and LLMs

Everyday conversations are more than exchanges of words—they reveal how people think, react, and adapt across situations. Through our speech we reveal the cognitive patterns that shape our behavior over time. Yet much of these patterns remains implicit: people operate through recurring heuristics and habits—some helpful, some limiting, many unnoticed. However, identifying such patterns requires self awareness that humans struggle with—and that current user modeling systems, often fragmented and narrowly tailored to specific tasks, fail to capture. Recognizing these patterns can enable user support systems to go beyond reactive assistance towards anticipatory support. We present Mind Mapper, an always-on wearable AI system that mines behavioral patterns from everyday real-life conversations. Mind Mapper employs a multi-stage LLM pipeline to generate, refine, and evaluate human-readable behavioral patterns. In a field study with 12 participants capturing over 700 hours of real-life conversational data, Mind Mapper generated behavioral patterns that participants consistently rated as accurate, unique, and helpful for reflection and behavior change. We further illustrate how such behavioral pattern modeling might enable new forms of human-AI interaction—anticipating user behavior through proactive interventions, adaptive content delivery, cognitive reframing, and behavioral simulation. Our results show the potential of always-on wearable systems with LLM-driven user models to support new forms of cognitively scaffolding, context-aware human-AI interactions.

• Publication year

  2026

• Venue

  International Conference on Intelligent User Interfaces

• Publication date

  2026-03-22

• Fields of study

  Computer Science, Psychology

• Identifiers
  DOI 10.1145/3742413.3789168
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• MemPal: Leveraging Multimodal AI and LLMs for Voice-Activated Object Retrieval in Homes of Older Adults

  2025cited by this paper
• Creating General User Models from Computer Use

  2025cited by this paper
• Pixel Memories: Do Lifelog Summaries Fail to Enhance Memory but Offer Privacy-Aware Memory Assessments?

  2025cited by this paper
• The Last JITAI? Exploring Large Language Models for Issuing Just-in-Time Adaptive Interventions: Fostering Physical Activity in a Prospective Cardiac Rehabilitation Setting

  2024cited by this paper
• A Resource Efficient System for On-Smartwatch Audio Processing

  2024cited by this paper
• Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation

  2024cited by this paper
• User-LLM: Efficient LLM Contextualization with User Embeddings

  2024cited by this paper
• Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback

  2023cited by this paper
• Automated Face-To-Face Conversation Detection on a Commodity Smartwatch with Acoustic Sensing

  2023cited by this paper
• When large language models meet personalization: perspectives of challenges and opportunities

  2023cited by this paper
• A survey on large language models for recommendation

  2023cited by this paper
• MemoryBank: Enhancing Large Language Models with Long-Term Memory

  2023cited by this paper
• Training language models to follow instructions with human feedback

  2022cited by this paper
• Chain of Thought Prompting Elicits Reasoning in Large Language Models

  2022cited by this paper
• Wearable, Environmental, and Smartphone-Based Passive Sensing for Mental Health Monitoring

  2021cited by this paper
• Using wearable cameras to investigate health-related daily life experiences: A literature review of precautions and risks in empirical studies

  2021cited by this paper
• Framing a Phenomenological Mixed Method: From Inspiration to Guidance

  2021cited by this paper
• Standalone Smartphone Cognitive Behavioral Therapy–Based Ecological Momentary Interventions to Increase Mental Health: Narrative Review

  2020cited by this paper
• CLOUD act agreements from an EU perspective

  2020cited by this paper
• Book review: Shoshana Zuboff, The Age of Surveillance Capitalism: The Fight for Human Future at the New Frontier of Power

  2019cited by this paper
• A survey on wearable sensor modality centred human activity recognition in health care

  2019cited by this paper
• Challenges with real-world smartwatch based audio monitoring

  2018cited by this paper
• Data mining for health: staking out the ethical territory of digital phenotyping

  2018cited by this paper
• Analysing privacy in visual lifelogging

  2017cited by this paper
• Framing a phenomenological interview: what, why and how

  2016cited by this paper
• Reviewing reflection: on the use of reflection in interactive system design

  2014cited by this paper
• A tutorial on human activity recognition using body-worn inertial sensors

  2014cited by this paper
• Anticipatory Mobile Computing

  2013cited by this paper
• Sociometric badges: Using sensor technology to capture new forms of collaboration

  2012cited by this paper
• Heuristic decision making.

  2011cited by this paper
• Complacency and Bias in Human Use of Automation: An Attentional Integration

  2010cited by this paper
• Privacy and consumer risks in cloud computing

  2010cited by this paper
• MyLifeBits: a personal database for everything

  2006cited by this paper
• Reality mining: sensing complex social systems

  2006cited by this paper
• The Bias Blind Spot: Perceptions of Bias in Self Versus Others

  2002cited by this paper
• Understanding and Using Context

  2001cited by this paper
• Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment

  1999cited by this paper
• Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior.

  1998cited by this paper
• Humans and Automation: Use, Misuse, Disuse, Abuse

  1997cited by this paper
• The ‘Barnum Effect’ in Personality Assessment: A Review of the Literature

  1985cited by this paper
• Judgment Under Uncertainty: Heuristics and Biases.

  1984cited by this paper
• The role of tutoring in problem solving.

  1976cited by this paper

• No citing papers are available for this paper.