Previously I was a Visiting Scholar at the CS Department of Carnegie Mellon University, working with Professor Luis von Ahn in the field of Human Computation. More recently, I spent four years at Endeca as a Senior Software Engineer.
My research is supported by the U.S. National Science Foundation Graduate Research Fellowship and by a California Legislature Grant for graduate studies.
An IDE extension that helps with the task of authoring multi-stage code examples by allowing the author to propagate changes (insertions, deletions and modifications) throughout multiple saved stages of their code.
Shiry Ginosar, Luis Fernando De Pombo, Maneesh Agrawala, Bjoern Hartmann, Authoring Multi-Stage Code Examples with Editable Code Histories, Proceedings, ACM symposium on User Interface Software and Technology, UIST 2013. (acceptance rate: 19%). PDF, video
A system that lets analysts use paid crowd workers to explore data sets and helps analysts interactively examine and build upon workers' insights.
Wesley Willett, Shiry Ginosar, Avital Steinitz, Bjoern Hartmann, Maneesh Agrawala, Identifying Redundancy and Exposing Provenance in Crowdsourced Data Analysis, IEEE Transactions on Visualization and Computer Graphics, 2013. PDF
Phetch is an online game which collects natural language descriptions for images on the web as a side effect of game play. Can be used to improve the accessibility of the web as well as improve upon current image search engines.
Shiry Ginosar, Human Computation for HCIR Evaluation, Proceedings, HCIR 2007, pp. 40-42. PDF
Luis von Ahn, Shiry Ginosar, Mihir Kedia, Manuel Blum, Improving Image Search with Phetch, Proceedings, International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2007. PDF
Luis von Ahn, Shiry Ginosar, Mihir Kedia, Ruoran Liu and Manuel Blum, Improving Accessibility of the Web with a Computer Game, Proceedings, ACM Conference on Human Factors in Computing Systems, CHI 2006, Montreal, Quebec, Canada, April 2006, pp. 79-82. Honorable mentioned paper and nominee for Best of CHI award. PDF
Object detection methods are often evaluated on datasets of camera-snapshot images. These do not cover the natural visual world nor do they represent the full ability of the human visual system. They are therefore a poor benchmark for evaluation. For example, human vision is surprisingly robust to the artificial form deformations in Cubist paintings that are rarely captured in image datasets such as perspective manipulation and part-reorganization. Here we test the performance of state-of-the-art object detectors on Cubist paintings and find that that while human perception significantly outperforms current methods, human perception and part-based models exhibit a similarly graceful degradation in performance as objects become increasingly deformed, thus corroborating the theory of part-based object representation in the brain.
Shiry Ginosar, Daniel Haas, Timothy Brown, Jitendra Malik Detecting People in Cubist Art, To Appear in Visart Workshop on Computer Vision for Art Analysis, European Conference on Computer Vision, ECCV 2014.
Speech input is growing in importance, especially in mobile applications, but less research has been done on speech input for information intensive tasks like document editing and coding. This paper presents results of a study on the use of a modern publicly available speech recognition system on document coding.
Shiry Ginosar, Marti A. Hearst, A Study of the Use of Current Speech Recognition in an Information Intensive Task, Workshop on Designing Speech and Language Interactions, ACM Conference on Human Factors in Computing Systems, CHI 2014. PDF
A tablet-controlled, solar-powered drip irrigation system. A humidity sensor at the tip of each "spike" records soil moisture; an internal servo in the 3D-printed enclosure opens and closes a drip irrigation line valve. Individual devices in a garden communicate with a central garden server, which also acts as a webserver that hosts the HTML-based user interface. Gardeners can review graphs of humidity readings over time and adjust waterning plans through this Web application.
Joint class project with Valkyrie Savage and Mark Fuge.
Featured in Bjoern Hartmann and Paul K. Wright Designing Bespoke Interactive Devices, IEEE Computer August 2013, Volume 46, Number 8. Article