EECS Joint Colloquium Distinguished Lecture Series

Wednesday, March 17, 2004
306 Soda Hall, Hewlett-Packard Auditorium
4:00-5:00 p.m.

Scott Klemmer

EECS Dept., UC Berkeley


Tangible User Interface Input: Tools and Techniques




Tangible user interfaces (TUIs) augment the physical world by integrating digital information with everyday physical objects. Developing tangible interfaces is challenging because programmers are responsible for acquiring and abstracting physical input. This is difficult, time-consuming, and requires a high level of technical expertise, especially with computer vision. To address this, we created Papier-Mâché, a toolkit for building tangible interfaces using computer vision, electronic tags, and barcodes. Papier-Mâché introduces high-level abstractions for working with these technologies that facilitate technology portability. For example, an application can be prototyped with computer vision and deployed with RFID. The design of Papier-Mâché has been deeply influenced by his experiences building physical interfaces over the past several years, specifically The Designers' Outpost and Books with Voices. The Designers' Outpost is a tangible user interface combining the affordances of paper and large physical workspaces with the advantages of electronic media to support information design. With Outpost, users collaboratively author web site information architectures on an electronic whiteboard using physical media (Post-it notes and images). Books with Voices, based on his contextual inquiry into the practices of oral historians, provides barcode augmented paper transcripts for fast, random access to digital video interviews on a PDA.


Scott Klemmer is a doctoral candidate in EECS who works in the Group for User Interface Research. His research interests lie in the area of human-computer interaction, especially software tools and interaction techniques that more seamlessly integrate the physical and electronic worlds. He holds a dual BA from Brown University in computer science and art-semiotics.