reacTIVision: a computer-vision framework for table-based tangible interaction

This article provides an introductory overview to first-time users of the reacTIVision framework -- an open-source cross-platform computer-vision framework primarily designed for the construction of table-based tangible user interfaces. The central component of the framework is a standalone application for fast and robust tracking of fiducial markers in a real-time video stream. The framework also defines a transport protocol for efficient and reliable transmission of object states via a local or wide area network. In addition, the distribution includes a collection of client example projects for various programming environments that allow the rapid development of unique tangible user interfaces. This article also provides a discussion of key points relevant to the construction of the necessary table hardware and surveys some projects that have been based on this technology.

• Publication year

  2007

• Venue

  International Conference on Tangible, Embedded, and Embodied Interaction

• Publication date

  2007-02-15

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1226969.1226983
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The reacTable: a tangible tabletop musical instrument and collaborative workbench

  2006cited by this paper
• Low-cost multi-touch sensing through frustrated total internal reflection

  2005cited by this paper
• Improved Topological Fiducial Tracking in the reacTIVision System

  2005cited by this paper
• The Design and Evolution of Fiducials for the reacTIVision System

  2005cited by this paper
• OpenSound Control: State of the Art 2003

  2003cited by this paper
• D-touch: A Consumer-Grade Tangible Interface Module and Musical Applications

  2003cited by this paper
• Virtual object manipulation on a table-top AR environment

  2000cited by this paper
• Emerging frameworks for tangible user interfaces

  2000cited by this paper

• ALGORITHM FOR ANALYZING NOISY VIDEO DATA FOR AUTONOMOUS ROBOTS NAVIGATION

  2025cites this paper
• TALH: A Tangible User Interface and Hand Gestures-Based Tool for Enhancing Animal Learning in Preschool

  2025cites this paper
• Physical Computing with Paper Playground: Exploring a Multimodal Platform

  2025cites this paper
• MusicBlocks: Crafting Interactive Musical Experiences on and beyond Tabletop With Multi-modal Tangible Interface

  2024cites this paper
• Tangible tabletops: practical experiment and considerations for a design framework

  2024cites this paper
• Inclusive multisensory science and immunology books for blind, low‐vision and diverse‐needs audiences

  2024cites this paper
• Enhanced STag Marker System: Materials and Methods for Flexible Robot Localisation

  2024cites this paper
• FidMark: A Fiducial Marker Ontology for Semantically Describing Visual Markers

  2024cites this paper
• Variations on a Hexagon: Iterative Design of Interactive Cyberphysical Tokens and Constraints

  2024cites this paper
• The migrating walls

  2024cites this paper
• MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré Effect

  2024cites this paper
• Chic-Marker: Fashionably Fusing Fiducial Markers into Apparel and Accessories

  2024cites this paper
• Dental implant positioning leveraging self-identifying projective invariant markers

  2024cites this paper
• TipTrack: Precise, Low-Latency, Robust Optical Pen Tracking on Arbitrary Surfaces Using an IR-Emitting Pen Tip

  2024cites this paper
• Stackable Music: A Marker-Based Augmented Reality Music Synthesis Game

  2023cites this paper
• Tingets 2.0: Computer Vision-Powered Interactive Social and Emotional Learning Tool

  2023cites this paper
• Planar fiducial markers: a comparative study

  2023cites this paper
• A portable geometry-independent tomographic system for gamma-ray, a next generation of nuclear waste characterization

  2023cites this paper
• CylinderTag: An Accurate and Flexible Marker for Cylinder-Shape Objects Pose Estimation Based on Projective Invariants

  2023cites this paper
• The Effect of Using Tangible User Interfaces Compared to Traditional Learning for Teaching Programming in Higher Education: An Experimental Study

  2023cites this paper
• Empowering soft skills in children with ADHD through the co-creation of tangible tabletop games

  2023cites this paper
• Efficient intraoral photogrammetry using self-identifying projective invariant marker

  2023cites this paper
• Introducing the Smart City to Children: Lessons Learned from Hands-On Workshops in Classes

  2023cites this paper
• Marking Material Interactions with Computer Vision

  2023cites this paper
• Reducing the Cognitive Load of Playing a Digital Tabletop Game with a Multimodal Interface

  2022cites this paper
• TangibleTouch: A Toolkit for Designing Surface-based Gestures for Tangible Interfaces

  2022cites this paper
• DynaTags: Low-Cost Fiducial Marker Mechanisms

  2022cites this paper
• Usability of Montessori tangible user interfaces to support learners’ retention skills in preschools

  2022cites this paper
• Directing Tangible Controllers with Computer Vision and Beholder

  2022cites this paper
• How do preschoolers interact with peers? Characterising child and group behaviour in games with tangible interfaces in school

  2022cites this paper
• Template Chart Detection for Stoma Telediagnosis

  2022cites this paper
• Examining the Effects of Embodied Interaction Modalities on Students’ Retention Skills in a Real Classroom Context

  2022cites this paper
• Conductive Fiducial Tangibles for Everyone

  2022cites this paper
• Efficient and Robust Circle Grids for Fiducial Detection

  2022cites this paper
• EMERGE Modular Robot: A Tool for Fast Deployment of Evolved Robots

  2021cites this paper
• Designing a Simple Fiducial Marker for Localization in Spatial Scenes Using Neural Networks

  2021cites this paper
• Touching Information with DIY Paper Charts & AR Markers

  2021cites this paper
• Designing a tangible tabletop installation and enacting a socioenactive experience with TangiTime

  2021cites this paper
• EMBody: A Data-Centric Toolkit for EMG-Based Interface Prototyping and Experimentation

  2021cites this paper
• Design, Detection, and Tracking of Customized Fiducial Markers

  2021cites this paper
• Sensory Extension of a Tangible Object for Physical User Interactions in Augmented Reality

  2021cites this paper
• Coarse and fine localized CNN classifier for intelligent DIC preprocessing in large structure health monitoring sample

  2021cites this paper
• Super-Resolution Capacitive Touchscreens

  2021cites this paper
• Towards Atmospheric Interfaces

  2021cites this paper
• Introducing the Smart City to Children with a Tangible Interaction Table: Expliquer la ville intelligente aux enfants avec une table d’interaction tangible

  2021cites this paper
• Tangibilisation of an educational scheduling game’s graphical interface: Tangibilisation de l’interface d’un jeu de formation à la planification

  2021cites this paper
• E2ETag: An End-to-End Trainable Method for Generating and Detecting Fiducial Markers

  2021cites this paper
• Towards Transparent Markers

  2021cites this paper
• Enabling Tangible Interaction through Detection and Augmentation of Everyday Objects

  2020cites this paper
• Projection-based Control for Mobile Robots Cooperating with Displayed Images

  2020cites this paper
• Domus: a multi-user TUI game for multi-touch tables

  2020influential citation
• Intelligent and Innovative Product Design and Application

  2020cites this paper
• PDCAT: a framework for fast, robust, and occlusion resilient fiducial marker tracking

  2020cites this paper
• LFTag: A Scalable Visual Fiducial System with Low Spatial Frequency

  2020cites this paper
• Tabletop teleporter: evaluating the immersiveness of remote board gaming

  2020cites this paper
• coisTable: An Individual-and-Spatial-Aware Tabletop System for Co-located Collaboration

  2020cites this paper
• PTPG: A Poisson Triangular Pattern Generator for Tokens on Tangible Surfaces

  2020cites this paper
• ForceStamps: Fiducial Markers for Pressure-sensitive Touch Surfaces to Support Rapid Prototyping of Physical Control Interfaces

  2020cites this paper
• Toward emotional interactive videogames for children with autism spectrum disorder

  2020cites this paper
• TIP-Toy: a tactile, open-source computational toolkit to support learning across visual abilities

  2020cites this paper
• CreaTable Content and Tangible Interaction in Aphasia

  2020cites this paper
• PATI: a projection-based augmented table-top interface for robot programming

  2019cites this paper
• Developing pervasive games in interactive spaces: the JUGUEMOS toolkit

  2019cites this paper
• TopoTag: A Robust and Scalable Topological Fiducial Marker System

  2019cites this paper
• Tangible user interface: origins, development, and future trends

  2019cites this paper
• Guidelines to design tangible tabletop activities for children with attention deficit hyperactivity disorder

  2019cites this paper
• KitVision toolkit: supporting the creation of cognitive activities for tangible tabletop devices

  2019cites this paper
• Color refinement using deep neural networks for enhancing color recognition in a projector‐camera system

  2019cites this paper
• Negotiating the Creative Space in Human-Robot Collaborative Design

  2019cites this paper
• Persuasive games in Interactive Spaces: The Hidden Treasure Game

  2019cites this paper
• ARCat: A Tangible Programming Tool for DFS Algorithm Teaching

  2019cites this paper
• Toy user interfaces: Systematic and industrial mapping

  2019cites this paper
• Putting the Framework to Operation: Enabling Organizational Development Through Learning

  2019cites this paper
• Designing Digital Work

  2019cites this paper
• Toward New Ecologies of Cyberphysical Representational Forms, Scales, and Modalities

  2019cites this paper
• Alignment of Multiple Perspectives: Establishing Common Ground for Triggering Organizational Change

  2019cites this paper
• Multi-Touch Kit: A Do-It-Yourself Technique for Capacitive Multi-Touch Sensing Using a Commodity Microcontroller

  2019cites this paper
• Hand-and-finger-awareness for mobile touch Interaction using deep learning

  2019cites this paper
• Enhancing a Tangible Tabletop with Embedded-Technology Objects for Experiencing Deep Time

  2019cites this paper
• Design and Evaluation of DIO Construction Toolkit for Co-making Shared Constructions

  2019cites this paper
• TangiTime: designing a (socio)enactive experience for deep time in an educational exhibit

  2019influential citation
• The Use of Tangible User Interface in Interactive System to Learn about Countries

  2019cites this paper
• Meeting the needs of people with neuro-developmental disorder through a phygital approach

  2019cites this paper
• Tackling developmental delays with therapeutic activities based on tangible tabletops

  2019cites this paper
• Visfer: Camera-based visual data transfer for cross-device visualization

  2019cites this paper
• Augmented Objects to Support People with Mild Cognitive Deficiences in Everyday Activities

  2018cites this paper
• A Tangible System for Learning Relational Algebra

  2018cites this paper
• Bots & (Main)Frames: Exploring the Impact of Tangible Blocks and Collaborative Play in an Educational Programming Game

  2018cites this paper
• Kawaluü: Macro Environment for Collaborative Surface with Dynamic Parameters using Tangible Objects

  2018cites this paper
• Evaluation Strategies for HCI Toolkit Research

  2018cites this paper
• TLogic: A Tangible Programming Tool to Help Children Solve Problems

  2018cites this paper
• Robust Coded Target Recognition in Adverse Light Conditions

  2018cites this paper
• An Active Tangible User Interface Framework for Teaching and Learning Artificial Neural Networks

  2018cites this paper
• Hierarchical fiducial marker design for pose estimation in large‐scale scenarios

  2018cites this paper
• A Novel Spatial Mandibular Motion-Capture System Based on Planar Fiducial Markers

  2018cites this paper
• Embedded Computation versus Embodied Interaction: Connected Objects for Connected Thinking

  2018cites this paper
• An Active Tangible User Interface Framework for Teaching and Learning Artificial Intelligence

  2018cites this paper
• Resolving display shape dependence issues on tabletops

  2018cites this paper
• ID'em

  2018cites this paper
• Feedback and Guidance to Support Children with Intellectual Disabilities in Discovery Learning with a Tangible Interactive Tabletop

  2018cites this paper