Electrical Engineering
      and Computer Sciences

Electrical Engineering and Computer Sciences

COLLEGE OF ENGINEERING

UC Berkeley

User-Extensible Natural Language Spoken Interfaces for Environment and Device Control

Ana Ramirez Chang

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2008-162
December 17, 2008

http://www.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-162.pdf

While the increase of electronic devices brings greater flexibility and control to our everyday environments, task-specific configuration of the myriad of devices becomes increasingly burdensome to the user. Ideally, interfaces for collections of such devices in our everyday environment should be calm, easy to learn and use, support control of favorite task specific configurations and allow the use of familiar names for configurations without learning. We propose a user-extensible natural language spoken interface for environment and device control. In order to support user customization in a natural language interface, the system must simultaneously learn the configurations and names for those configurations. We call this the simultaneous naming and configuration (SNAC) problem. In this thesis, we identify and describe an approach to the simultaneous naming and configuration problem, and present a specific realization of our approach to the SNAC problem called Illuminac. We find that this kind of user-extensible speech interface is quite effective for some types of users and thus an important component in a complete solution to device configuration. In particular, we observe that users are willing to train the system, able to remember their commands, and willing to use voice commands in many cases.

Advisor: John F. Canny


BibTeX citation:

@phdthesis{Chang:EECS-2008-162,
    Author = {Chang, Ana Ramirez},
    Title = {User-Extensible Natural Language Spoken Interfaces for Environment and Device Control},
    School = {EECS Department, University of California, Berkeley},
    Year = {2008},
    Month = {Dec},
    URL = {http://www.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-162.html},
    Number = {UCB/EECS-2008-162},
    Abstract = {While the increase of electronic devices brings greater flexibility and control to our everyday environments, task-specific configuration of the myriad of devices becomes increasingly burdensome to the user.  Ideally, interfaces for collections of such devices in our everyday environment should be calm, easy to learn and use, support control of favorite task specific configurations and allow the use of familiar names for configurations without learning.  We propose a user-extensible natural language spoken interface for environment and device control.  In order to support user customization in a natural language interface, the system must simultaneously learn the configurations and names for those configurations.  We call this the simultaneous naming and configuration (SNAC) problem.  

In this thesis, we identify and describe an approach to the simultaneous naming and configuration problem, and present a specific realization of our approach to the SNAC problem called Illuminac.  We find that this kind of user-extensible speech interface is quite effective for some types of users and thus an important component in a complete solution to device configuration.  In particular, we observe that users are willing to train the system, able to remember their commands, and willing to use voice commands in many cases.}
}

EndNote citation:

%0 Thesis
%A Chang, Ana Ramirez
%T User-Extensible Natural Language Spoken Interfaces for Environment and Device Control
%I EECS Department, University of California, Berkeley
%D 2008
%8 December 17
%@ UCB/EECS-2008-162
%U http://www.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-162.html
%F Chang:EECS-2008-162