Flow, Staging, Wayfinding, Personalization: Evaluating User Experience with Mobile Museum Narratives

A multitude of challenges comes into play when attempting to design (and evaluate) an interactive digital storytelling experience for use by visitors in a museum. This paper reports on the evaluation of the prototype mobile-based storytelling “guides” designed, developed and deployed as part of a research project at the Acropolis Museum in Athens, Greece. Experiences designed for different visitor profiles were evaluated several times throughout the iterative design process, in a number of on-site studies, and with more than 180 museum visitors of all ages (with this paper reporting on two studies conducted with a total of 53 users visiting individually or in pairs). The evaluation methods included ethnography (i.e., observation of visitors in the Museum’s galleries), pre- and post-experience in-depth interviews and questionnaires to measure the Users’ Experience (UX), as well as data logging. The analysis of the data focused on themes representing components of the experiences, such as interactive story plot and narration, staging and way-finding in the physical space, personalization and social interaction. Our findings confirmed that understanding UX and what makes it effective or not in the rich context of a cultural setting is a complex endeavor. The paper discusses our findings and proposes relevant recommendations for the design of digital experiences for cultural, educational, and recreational purposes.

• Publication year

  2018

• Venue

  Multimodal Technologies and Interaction

• Publication date

  2018-06-11

• Fields of study

  Art, Sociology, Computer Science, Education

• Identifiers
  DOI 10.3390/MTI2020032
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Telling Tales

  2020cited by this paper
• Time spent viewing art and reading labels.

  2017cited by this paper
• Moving beyond the virtual museum: Engaging visitors emotionally

  2017cited by this paper
• Visualizing museum visitors’ behavior: Where do they go and what do they do there?

  2017cited by this paper
• Families and Mobile Devices in Museums

  2016cited by this paper
• Capturing the Visitor Profile for a Personalized Mobile Museum Experience: an Indirect Approach

  2016cited by this paper
• Cultivating Mobile-Mediated Social Interaction in the Museum: Towards Group-Based Digital Storytelling Experiences

  2016cited by this paper
• The Museum as Digital Storyteller: Collaborative Participatory Creation of Interactive Digital Experiences

  2015cited by this paper
• Conducting Visitor Studies Using Smartphone-Based Location Sensing

  2015cited by this paper
• Supporting group interactions in museum visiting

  2014cited by this paper
• A life of their own: museum visitor personas penetrating the design lifecycle of a mobile experience

  2013influential reference
• A digital look at physical museum exhibits: Designing personalized stories with handheld Augmented Reality in museums

  2013cited by this paper
• see me, feel me, touch me, hear me: trajectories and interpretation in a sculpture garden

  2013cited by this paper
• Indoors and outdoors: designing mobile experiences for Cité de l’espace

  2013cited by this paper
• Measuring visitors' experiences with mobile guide technology in cultural spaces

  2012influential reference
• Towards Personalized Storytelling for Museum Visits

  2012cited by this paper
• Storytelling on mobile devices for cultural heritage

  2012cited by this paper
• Visitor Reception to Location-based Interpretation at Archaeological and Heritage Sites

  2012influential reference
• The Museum Experience Revisited

  2012cited by this paper
• User Experience Evaluation - Which Method to Choose?

  2011cited by this paper
• Personalization in cultural heritage: the road travelled and the one ahead

  2011cited by this paper
• A visitor's guide in an active museum: Presentations, communications, and reflection

  2011cited by this paper
• Digital Storytelling in Museums: Observations and Best Practices

  2011cited by this paper
• Personalizing Interactive Digital Storytelling in Archaeological Museums: the CHESS Project

  2011cited by this paper
• The measurability and predictability of user experience

  2011cited by this paper
• From interaction to trajectories: designing coherent journeys through user experiences

  2009cited by this paper
• Digital technologies and the museum experience: Handheld guides and other media

  2009cited by this paper
• Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit

  2008influential reference
• A stroll with Carletto: adaptation in drama-based tours with virtual characters

  2008cited by this paper
• Interactive Storytelling and Gaming Environments for Museums: The Interactive Storytelling Exhibition Project

  2007cited by this paper
• A constructivist mobile learning environment supported by a wireless handheld network

  2004cited by this paper
• A study of user experiences mediated by nomadic web content in a museum

  2003cited by this paper
• DISPLACING THE OBJECT: MOBILE TECHNOLOGIES AND INTERPRETIVE RESOURCES

  2003influential reference
• Revisiting the visit:: understanding how technology can shape the museum visit

  2002cited by this paper
• The Conversational Role of Electronic Guidebooks

  2001cited by this paper
• Electronic Guidebooks and Visitor Attention

  2001cited by this paper
• The experience economy : work is theatre & every business a stage

  1999cited by this paper
• The Natural History Museum

  year unknowncited by this paper

• Analyzing Visitor Behavior to Enhance Personalized Experiences in Smart Museums: A Systematic Literature Review

  2025cites this paper
• Designing for Immersion: A Cross-Platform Evaluation Framework for XR Heritage Storytelling

  2025cites this paper
• Gamified Immersive Learning and User Experience Evaluation of Metaverse-Based Cultural Heritage Education

  2025cites this paper
• Furiose Interazioni Project

  2025influential citation
• Muse-Torch: Interactive Museum Guide System Using a Pico-Projector for Children

  2025cites this paper
• Going beyond digital libraries: a literature review of phygital user experience research methods

  2025cites this paper
• Robust Predictors of Mobile Phone Reliance for Information Seeking: A Multi-Stage Empirical Analysis and Validation

  2025cites this paper
• Experiential Approach to a Neolithic Lakeside Settlement Using Extended Reality (XR) Technologies

  2025cites this paper
• Engendering Visitor Narrative: The Case of Shaanxi Archaeology Museum

  2025cites this paper
• Natural movement: Measuring optimal pathway configuration of museum layout and pedestrian accessibility through visibility graph analysis and intelligent agent simulation

  2025cites this paper
• Exploring Gen Z’s Perceptions of Virtual Tour Guide Narratives in Heritage Tourism: An Integrated Approach of TAM and Destination Image Theory

  2025cites this paper
• Research by Design (RbD) Method as a Process for Creating an Effective Museum Message

  2025cites this paper
• Multidimensional Analysis of Visitor Interaction With Museum Apps: Designing for Enhanced Museum Experiences

  2025cites this paper
• Who Killed Helene Pumpulivaara?: Exploring Narrative Design and Extended Reality in Industrial Heritage Interpretation

  2025influential citation
• Experiencing Art Museum with a Generative Artificial Intelligence Chatbot

  2025cites this paper
• Evaluating visitors' experience in museum: Comparing artificial intelligence and multi-partitioned analysis

  2024cites this paper
• A network study of user path optimisation in personalised experience design for museums

  2024cites this paper
• Understanding the Role of Personalisation in Augmented Reality Applications for Enhancing User Experience

  2024cites this paper
• ArtStory Beats: Highlighting Interactions between Visual Arts and Music with Storytelling

  2024cites this paper
• Integrating restoration and interactive exploration to enhance cultural heritage through VR storytelling

  2024cites this paper
• The Evolution of Digital Cultural Heritage Research: Identifying Key Trends, Hotspots, and Challenges through Bibliometric Analysis

  2024cites this paper
• Creating and applying a data model for an Augmented Documentation of Cultural Heritage

  2024cites this paper
• Towards Identifying Visitor Types in Virtual Museums Using Spatial and Interaction Data

  2024cites this paper
• Talkative Museum: Augmented Reality Interactive Museum Guide System Towards Collaborative Child-Parent-Specimen Interaction

  2024cites this paper
• Museums for Older Adults and Mobility-Impaired People: Applying Inclusive Design Principles and Digital Storytelling Guidelines—A Review

  2024influential citation
• Advanced systems and technologies for the enhancement of user experience in cultural spaces: an overview

  2024influential citation
• Applying Cinematic Virtual Reality with Adaptability to Indigenous Storytelling

  2024cites this paper
• Towards a Machine Learning Smart Toy Design for Early Childhood Geometry Education: Usability and Performance

  2023cites this paper
• The Use of Augmented Metadata in the Museum Environment

  2023cites this paper
• Research on the Quality Control Method of Cultural Heritage Digital Information Service: A Case Study of the Digital Cultural Relics Library Platform of the Palace Museum in Beijing

  2023cites this paper
• Design, content validity, and inter-observer reliability of the ‘Digitization of Cultural Heritage, Identities, and Education’ (DICHIE) instrument

  2023cites this paper
• The Sacra Infermeria—a focus group evaluation of an augmented reality cultural heritage experience

  2022cites this paper
• Designing an Augmented Experience for a Music Archive: What does the Audience Need Beyond the Sense of Hearing?

  2022cites this paper
• Mobile Presentation of the War History of the City of Niš

  2022cites this paper
• Integrating user experience assessment in Re-CRUD console framework development

  2022cites this paper
• History education done different: A collaborative interactive digital storytelling approach for remote learners

  2022cites this paper
• Digital Creativity and the Regional Museum: Experimental Collaboration at the Convergence of Immersive Media and Exhibition Design

  2022cites this paper
• Evaluation of virtual tour in an online museum: Exhibition of Architecture of the Forbidden City

  2022cites this paper
• Interaction in eXtended Reality Applications for Cultural Heritage

  2022cites this paper
• Digital Technologies and the Role of Data in Cultural Heritage: The Past, the Present, and the Future

  2022cites this paper
• Tangible and Personalized DS Application Approach in Cultural Heritage: The CHATS Project

  2022cites this paper
• When Digital Doesn't Work: Experiences of Co-Designing an Indigenous Community Museum

  2022cites this paper
• Wiki Loves Monuments: Crowdsourcing the Collective Image of the Worldwide Built Heritage

  2022cites this paper
• How Was It for You? Qualitative Observational Methods to Assess the Experiential Value of Two Immersive Augmented Reality Stories: A Case Study

  2021cites this paper
• Embodying a Narrative: Spatializing Abstract Narrative Themes for Forensic Exploration

  2021cites this paper
• Designing a Virtual Arboretum as an Immersive, Multimodal, Interactive, Data Visualization Virtual Field Trip

  2021cites this paper
• Quality Characteristics of an LMS UX Psychomotor Model for the Design and Evaluation of Learning Management Systems

  2021cites this paper
• Place-Based Digital Storytelling. The Interplay Between Narrative Forms and the Cultural Heritage Space

  2021cites this paper
• Online Museums Segmentation with Structured Data: The Case of the Canary Island's Online Marketplace

  2021cites this paper
• Evaluation in Virtual Heritage

  2021cites this paper
• Digital Storytelling and Social Interaction in Cultural Heritage - An Approach for Sites with Reduced Connectivity

  2021cites this paper
• Personalisation of data-driven storytelling

  2021cites this paper
• Fostering inclusion in art museums through mobile digital content

  2021cites this paper
• How does frame-loss affect users’ perception of smoothness?

  2021cites this paper
• Methods and Practices for Assessing the User Experience of Interactive Systems for Cultural Heritage

  2020cites this paper
• Adding Culture to UX

  2020cites this paper
• Unsupervised learning on multimedia data: a Cultural Heritage case study

  2020cites this paper
• Guiding visitors in museums with calm interactions

  2020cites this paper
• Mediating distance: new interfaces and interaction design techniques to follow and take part in remote museum visits

  2020cites this paper
• Sarajevo War Tunnel - Mobile Virtual Cultural Heritage Application

  2020cites this paper
• Interaction homme-machine et personnalisation des visites : enjeux et perspectives critiques

  2020cites this paper
• Design of Digital Interaction for Complex Museum Collections

  2020cites this paper
• Virtual dioramas transform natural history museum exhibit halls & gardens to life with immersive AR

  2020cites this paper
• Enhanced Exhibitions? Discussing Museum Apps after a Decade of Development

  2020cites this paper
• “Let Them Talk!”

  2020cites this paper
• Exploring the Potential of Visually-Rich Animated Digital Storytelling for Cultural Heritage

  2020cites this paper
• Tourism demonstration system for large-scale museums based on 3D virtual simulation technology

  2020cites this paper
• Beyond Virtual Museums: Adopting Serious Games and Extended Reality (XR) for User-Centred Cultural Experiences

  2020cites this paper
• Visual Computing for Cultural Heritage

  2020cites this paper
• Mobile interactive storytelling at the Ancient Agora of Athens: exploring the right balance between the site and the digital application

  2019cites this paper
• A STUDY OF USER EXPERIENCE FOR E-LEARNING USING INTERACTIVE ONLINE TECHNOLOGIES

  2019cites this paper
• A virtual logbook for the documentation of a continuously changing archaeological site: the San Clemente site in Albenga (Italy)

  2019cites this paper
• MRsive: An Augmented Reality Tool for Enhancing Wayfinding and Engagement with Art in Museums

  2019cites this paper
• Websites with Multimedia Content: A Heuristic Evaluation of the Medical/Anatomical Museums

  2019cites this paper
• Awe or empathy, fast or slow? Articulating impacts from contrasting mobile experiences

  2019influential citation
• Human-Computer Interactions in Museums

  2019cites this paper
• Transformation through Provocation?

  2019cites this paper
• A Mobile App to Learn About Cultural and Historical Associations in a Closed Loop with Humanities Experts

  2018cites this paper
• How to play storytelling games with masterpieces: from art galleries to hybrid board games

  2018cites this paper
• Applying Interactive Storytelling in Cultural Heritage: Opportunities, Challenges and Lessons Learned

  2018cites this paper
• A conceptual model of heritage dimensions and agrotourism: Perspective of Nandi County in Kenya

  2018influential citation
• Quality of Experience in Cyber-Physical Social Systems Based on Reinforcement Learning and Game Theory

  2018cites this paper
• Digital Cultural Heritage

  2018cites this paper
• A Storytelling Smart-City Approach to Further Cross-Regional Tourism

  2018cites this paper
• Approaching “Dark Heritage” Through Essential Questions: An Interactive Digital Storytelling Museum Experience

  year unknowncites this paper
• Transformation through Provocation ? Designing a ‘ Bot of Conviction ’ to Challenge Conceptions and Evoke Critical Reflection

  year unknowncites this paper