TY - GEN
T1 - Video tapestries with continuous temporal zoom
AU - Barnes, Connelly
AU - Goldman, Dan B.
AU - Shechtman, Eli
AU - Finkelstein, Adam
N1 - Publisher Copyright: © 2010 ACM.
PY - 2010/7/26
Y1 - 2010/7/26
N2 - We present a novel approach for summarizing video in the form of a multiscale image that is continuous in both the spatial domain and across the scale dimension: There are no hard borders between discrete moments in time, and a user can zoom smoothly into the image to reveal additional temporal details. We call these artifacts tapestries because their continuous nature is akin to medieval tapestries and other narrative depictions predating the advent of motion pictures. We propose a set of criteria for such a summarization, and a series of optimizations motivated by these criteria. These can be performed as an entirely offline computation to produce high quality renderings, or by adjusting some optimization parameters the later stages can be solved in real time, enabling an interactive interface for video navigation. Our video tapestries combine the best aspects of two common visualizations, providing the visual clarity of DVD chapter menus with the information density and multiple scales of a video editing timeline representation. In addition, they provide continuous transitions between zoom levels. In a user study, participants preferred both the aesthetics and efficiency of tapestries over other interfaces for visual browsing.
AB - We present a novel approach for summarizing video in the form of a multiscale image that is continuous in both the spatial domain and across the scale dimension: There are no hard borders between discrete moments in time, and a user can zoom smoothly into the image to reveal additional temporal details. We call these artifacts tapestries because their continuous nature is akin to medieval tapestries and other narrative depictions predating the advent of motion pictures. We propose a set of criteria for such a summarization, and a series of optimizations motivated by these criteria. These can be performed as an entirely offline computation to produce high quality renderings, or by adjusting some optimization parameters the later stages can be solved in real time, enabling an interactive interface for video navigation. Our video tapestries combine the best aspects of two common visualizations, providing the visual clarity of DVD chapter menus with the information density and multiple scales of a video editing timeline representation. In addition, they provide continuous transitions between zoom levels. In a user study, participants preferred both the aesthetics and efficiency of tapestries over other interfaces for visual browsing.
KW - Patch-based synthesis
KW - Video summarization
UR - http://www.scopus.com/inward/record.url?scp=85019103613&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85019103613&partnerID=8YFLogxK
U2 - 10.1145/1778765.1778826
DO - 10.1145/1778765.1778826
M3 - Conference contribution
T3 - ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010
BT - ACM SIGGRAPH 2010 Papers, SIGGRAPH 2010
A2 - Hoppe, Hugues
PB - Association for Computing Machinery, Inc
T2 - 37th International Conference and Exhibition on Computer Graphics and Interactive Techniques, SIGGRAPH 2010
Y2 - 26 July 2010 through 30 July 2010
ER -