Research Projects

Photo-Oriented Questions

*** THIS PROJECT IS NO LONGER ACTIVE ***

Trevor Darrell, Tom Yeh¹ and John Lee²

Photo-oriented question (POQ) is a new method to interface with community-based question answering services. By offering an extra modality--photos, in addition to the text modality to form queries, photo-oriented question is an attempt to overcome the limitations of text-only input methods when it comes to asking questions regarding visually distinctive objects. It is especially useful when users encounter an interesting object in the environment and want to inquire about it--simply by taking a photo and asking a question in a situated (from a mobile device) and intuitive (without describing the object in words) manner

[1]

Tom Yeh, John Lee, and Trevor Darrell, Photo-based Question Answering, ACM Multimedia 2008

¹MIT
²Google