Time-varying surface reconstruction of an actor’s performance

Ludovic Blache, Mathieu Desbrun, Céline Loscos, Laurent Lucas

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose a fully automatic time-varying surface reconstruction of an actor’s performance captured from a production stage through omnidirectional video. The resulting mesh and its texture can then directly be edited in post-production. Our method makes no assumption on the costumes or accessories present in the recording. We take as input a raw sequence of volumetric static poses reconstructed from video sequences acquired in a multi-viewpoint chroma-key studio. The first frame is chosen as the reference mesh. An iterative approach is applied throughout the sequence in order to induce a deformation of the reference mesh for all input frames. At first, a pseudo-rigid transformation adjusts the pose to match the input visual hull as closely as possible. Then, local deformation is added to reconstruct fine details. We provide examples of actors’ performance inserted into virtual scenes, including dynamic interaction with the environment.

Original languageEnglish
Title of host publicationAdvances in Visual Computing - 11th International Symposium, ISVC 2015, Proceedings
EditorsMark Elendt, Richard Boyle, Eric Ragan, Bahram Parvin, Rogerio Feris, Tim McGraw, Ioannis Pavlidis, Regis Kopper, George Bebis, Darko Koracin, Zhao Ye, Gunther Weber
PublisherSpringer Verlag
Pages92-101
Number of pages10
ISBN (Print)9783319278568
DOIs
Publication statusPublished - 1 Jan 2015
Externally publishedYes
Event11th International Symposium on Advances in Visual Computing, ISVC 2015 - Las Vegas, United States
Duration: 14 Dec 201516 Dec 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9474
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Symposium on Advances in Visual Computing, ISVC 2015
Country/TerritoryUnited States
CityLas Vegas
Period14/12/1516/12/15

Fingerprint

Dive into the research topics of 'Time-varying surface reconstruction of an actor’s performance'. Together they form a unique fingerprint.

Cite this