Electrical Engineering
      and Computer Sciences

Electrical Engineering and Computer Sciences


UC Berkeley


2010 Research Summary

Perceptual Interpretation of Ink Annotations on Line Charts

View Current Project Information

Nicholas Kong and Maneesh Agrawala

National Science Foundation CCF-0643552 and Natural Sciences and Engineering Research Council of Canada PGS M

Asynchronous collaborators often use freeform ink annotations to point to visually salient perceptual features of line charts such as peaks or humps, valleys, rising slopes and declining slopes. We present a set of techniques for interpreting such annotations to algorithmically identify the corresponding perceptual parts. Our approach is to first apply a parts-based segmentation algorithm that identifies the visually salient perceptual parts in the chart. Our system then analyzes the freeform annotations to infer the corresponding peaks, valleys or sloping segments. Once the system has identified the perceptual parts it can highlight them to draw further attention and reduce ambiguity of interpretation in asynchronous collaborative discussions.

Figure 1
Figure 1: An interpreted annotation in our system.

T. Baudel. A mark-based interaction paradigm for free-hand drawing. In Proc. of UIST, pages 185–192, 1994.
J. Heer, M. Agrawala, and W. Willett. Generalized selection via interactive query relaxation. In Proc. of CHI, pages 959– 968, 2008.
W. C. Hill and J. D. Hollan. Deixis and the future of visualization excellence. In Proc. of IEEE Visualization, pages 314–320, 431, 1991.
D. D. Hoffman and M. Singh. Salience of visual parts. Cognition, 63:29–78, 1997.
E. Saund and T.P. Moran. A perceptually-supported sketch editor. In Proc. of UIST, pages 175–184, 1994.