Learning controls for blend shape based realistic facial animation

Pushkar Joshi; Wen C. Tien; Mathieu Desbrun; Frédéric Pighin

doi:10.2312/SCA03/187-192

Learning controls for blend shape based realistic facial animation

Pushkar Joshi
, Wen C. Tien
, Mathieu Desbrun
, Frédéric Pighin

Computer Science Department
University of Southern California
University of Southern California

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

112 Citations (Scopus)

Abstract

Blend shape animation is the method of choice for keyframe facial animation: a set of blend shapes (key facial expressions) are used to define a linear space of facial expressions. However, in order to capture a significant range of complexity of human expressions, blend shapes need to be segmented into smaller regions where key idiosyncracies of the face being animated are present. Performing this segmentation by hand requires skill and a lot of time. In this paper, we propose an automatic, physically-motivated segmentation that learns the controls and parameters directly from the set of blend shapes. We show the usefulness and efficiency of this technique for both, motion-capture animation and keyframing. We also provide a rendering algorithm to enhance the visual realism of a blend shape model.

Original language	English
Title of host publication	Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003
Publisher	Association for Computing Machinery
Pages	187-192
Number of pages	6
ISBN (Print)	1581136595, 9781581136593
DOIs	https://doi.org/10.2312/SCA03/187-192
Publication status	Published - 26 Jul 2003
Externally published	Yes
Event	2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003 - San Diego, United States Duration: 26 Jul 2003 → 27 Jul 2003

Publication series

Name	Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003

Conference

Conference	2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003
Country/Territory	United States
City	San Diego
Period	26/07/03 → 27/07/03

Access to Document

10.2312/SCA03/187-192

Cite this

Joshi, P., Tien, W. C., Desbrun, M., & Pighin, F. (2003). Learning controls for blend shape based realistic facial animation. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003 (pp. 187-192). (Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003). Association for Computing Machinery. https://doi.org/10.2312/SCA03/187-192

@inproceedings{d90001efe30d432fa6288615c4a1f6a4,

title = "Learning controls for blend shape based realistic facial animation",

abstract = "Blend shape animation is the method of choice for keyframe facial animation: a set of blend shapes (key facial expressions) are used to define a linear space of facial expressions. However, in order to capture a significant range of complexity of human expressions, blend shapes need to be segmented into smaller regions where key idiosyncracies of the face being animated are present. Performing this segmentation by hand requires skill and a lot of time. In this paper, we propose an automatic, physically-motivated segmentation that learns the controls and parameters directly from the set of blend shapes. We show the usefulness and efficiency of this technique for both, motion-capture animation and keyframing. We also provide a rendering algorithm to enhance the visual realism of a blend shape model.",

author = "Pushkar Joshi and Tien, \{Wen C.\} and Mathieu Desbrun and Fr{\'e}d{\'e}ric Pighin",

note = "Publisher Copyright: {\textcopyright} The Eurographics Association 2003.; 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003 ; Conference date: 26-07-2003 Through 27-07-2003",

year = "2003",

month = jul,

day = "26",

doi = "10.2312/SCA03/187-192",

language = "English",

isbn = "1581136595",

series = "Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003",

publisher = "Association for Computing Machinery",

pages = "187--192",

booktitle = "Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003",

}

Joshi, P, Tien, WC, Desbrun, M & Pighin, F 2003, Learning controls for blend shape based realistic facial animation. in Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003. Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003, Association for Computing Machinery, pp. 187-192, 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003, San Diego, United States, 26/07/03. https://doi.org/10.2312/SCA03/187-192

Learning controls for blend shape based realistic facial animation. / Joshi, Pushkar; Tien, Wen C.; Desbrun, Mathieu et al.
Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003. Association for Computing Machinery, 2003. p. 187-192 (Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Learning controls for blend shape based realistic facial animation

AU - Joshi, Pushkar

AU - Tien, Wen C.

AU - Desbrun, Mathieu

AU - Pighin, Frédéric

PY - 2003/7/26

Y1 - 2003/7/26

N2 - Blend shape animation is the method of choice for keyframe facial animation: a set of blend shapes (key facial expressions) are used to define a linear space of facial expressions. However, in order to capture a significant range of complexity of human expressions, blend shapes need to be segmented into smaller regions where key idiosyncracies of the face being animated are present. Performing this segmentation by hand requires skill and a lot of time. In this paper, we propose an automatic, physically-motivated segmentation that learns the controls and parameters directly from the set of blend shapes. We show the usefulness and efficiency of this technique for both, motion-capture animation and keyframing. We also provide a rendering algorithm to enhance the visual realism of a blend shape model.

AB - Blend shape animation is the method of choice for keyframe facial animation: a set of blend shapes (key facial expressions) are used to define a linear space of facial expressions. However, in order to capture a significant range of complexity of human expressions, blend shapes need to be segmented into smaller regions where key idiosyncracies of the face being animated are present. Performing this segmentation by hand requires skill and a lot of time. In this paper, we propose an automatic, physically-motivated segmentation that learns the controls and parameters directly from the set of blend shapes. We show the usefulness and efficiency of this technique for both, motion-capture animation and keyframing. We also provide a rendering algorithm to enhance the visual realism of a blend shape model.

U2 - 10.2312/SCA03/187-192

DO - 10.2312/SCA03/187-192

M3 - Conference contribution

AN - SCOPUS:84867845622

SN - 1581136595

SN - 9781581136593

T3 - Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003

SP - 187

EP - 192

BT - Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003

PB - Association for Computing Machinery

T2 - 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003

Y2 - 26 July 2003 through 27 July 2003

ER -

Joshi P, Tien WC, Desbrun M, Pighin F. Learning controls for blend shape based realistic facial animation. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003. Association for Computing Machinery. 2003. p. 187-192. (Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2003). doi: 10.2312/SCA03/187-192

Learning controls for blend shape based realistic facial animation

Abstract

Publication series

Conference

Access to Document

Fingerprint

Cite this