Project  Beholder



The electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we developed Beholder—a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces.

We built a visual editor to facilitate this CV-driven approach to physical computing. This editor supports people to connect different parameters of these markers (such as presence, position, and rotation) to keyboard input. This enables CV-driven interfaces to control any software that takes keyboard as an input.

Authors
Peter Gyory
Krithik Ranjan
Ellen Yi-Luen Do
Clement Zheng

CHI 2023
SA Emerging Tech 2022
GitHub











©2024 Interactive Materials Lab