Future User Interfaces
Star Trek style UI
- verbally ask the computer for information
- may be common in mobile/hands-free situations
- problem: hard to design & build
- requires perfect speech recog. & language understanding
Multimodal, Context-aware UIs
- multimodal
- user says “retrieve something like this” while pointing
- combines speech w/ gesture to disambiguate (multimodal)
- context-aware
- people are talking -> don’t rely on speech I/O
- problem: how do you prototype & test these new design ideas?
- Informal UI Design Tools!