Shape-Time Photography

William T. Freeman and Hao Zhang

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-02-1171
January 2002

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2002/CSD-02-1171.pdf

We introduce a new method to describe, in a single image, changes in shape over time. We acquire both range and image information with a stationary stereo camera. From the pictures taken, we display a composite image consisting of the image data from the surface closest to the camera at every pixel. This reveals the 3-d relationships over time by easy-to-interpret occlusion relationships in the composite image. We call the composite a shape-time photograph.

Small errors in depth measurements cause artifacts in the shape-time images. We correct most of these using a Markov network to estimate the most probable front surface, taking into account the depth measurements, their uncertainties, and layer continuity assumptions.


BibTeX citation:

@techreport{Freeman:CSD-02-1171,
    Author = {Freeman, William T. and Zhang, Hao},
    Title = {Shape-Time Photography},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2002},
    Month = {Jan},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2002/5657.html},
    Number = {UCB/CSD-02-1171},
    Abstract = {We introduce a new method to describe, in a single image, changes in shape over time. We acquire both range and image information with a stationary stereo camera. From the pictures taken, we display a composite image consisting of the image data from the surface closest to the camera at every pixel. This reveals the 3-d relationships over time by easy-to-interpret occlusion relationships in the composite image. We call the composite a shape-time photograph. <p>Small errors in depth measurements cause artifacts in the shape-time images. We correct most of these using a Markov network to estimate the most probable front surface, taking into account the depth measurements, their uncertainties, and layer continuity assumptions.}
}

EndNote citation:

%0 Report
%A Freeman, William T.
%A Zhang, Hao
%T Shape-Time Photography
%I EECS Department, University of California, Berkeley
%D 2002
%@ UCB/CSD-02-1171
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2002/5657.html
%F Freeman:CSD-02-1171