Project Beholder

The electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we developed Beholder—a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces.

We built a visual editor to facilitate this CV-driven approach to physical computing. This editor supports people to connect different parameters of these markers (such as presence, position, and rotation) to keyboard input. This enables CV-driven interfaces to control any software that takes keyboard as an input.

Authors
Peter Gyory
Krithik Ranjan
Ellen Yi-Luen Do
Clement Zheng

CHI 2023

SA Emerging Tech 2022

GitHub