Deep graphics encoder for real-time video makeup synthesis from example

Robin Kips; Ruowei Jiang; Sileye Ba; Edmund Phung; Parham Aarabi; Pietro Gori; Matthieu Perrot; Isabelle Bloch

doi:10.1109/CVPRW53098.2021.00431

Deep graphics encoder for real-time video makeup synthesis from example

Robin Kips
, Ruowei Jiang
, Sileye Ba
, Edmund Phung
, Parham Aarabi
, Pietro Gori
, Matthieu Perrot
, Isabelle Bloch

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

While makeup virtual-try-on is now widespread, parametrizing a computer graphics rendering engine for synthesizing images of a given cosmetics product remains a challenging task. In this paper, we introduce an inverse computer graphics method for automatic makeup synthesis from a reference image, by learning a model that maps an example portrait image with makeup to the space of rendering parameters. This method can be used by artists to automatically create realistic virtual cosmetics image samples, or by consumers, to virtually try-on a makeup extracted from their favorite reference image.

Original language	English
Title of host publication	Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021
Publisher	IEEE Computer Society
Pages	3884-3888
Number of pages	5
ISBN (Electronic)	9781665448994
DOIs	https://doi.org/10.1109/CVPRW53098.2021.00431
Publication status	Published - 1 Jun 2021
Event	2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021 - Virtual, Online, United States Duration: 19 Jun 2021 → 25 Jun 2021

Publication series

Name	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)	2160-7508
ISSN (Electronic)	2160-7516

Conference

Conference	2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021
Country/Territory	United States
City	Virtual, Online
Period	19/06/21 → 25/06/21

Access to Document

10.1109/CVPRW53098.2021.00431

Cite this

Kips, R., Jiang, R., Ba, S., Phung, E., Aarabi, P., Gori, P., Perrot, M., & Bloch, I. (2021). Deep graphics encoder for real-time video makeup synthesis from example. In Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021 (pp. 3884-3888). (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). IEEE Computer Society. https://doi.org/10.1109/CVPRW53098.2021.00431

@inproceedings{671b103198c6476ebb83165c595316c8,

title = "Deep graphics encoder for real-time video makeup synthesis from example",

abstract = "While makeup virtual-try-on is now widespread, parametrizing a computer graphics rendering engine for synthesizing images of a given cosmetics product remains a challenging task. In this paper, we introduce an inverse computer graphics method for automatic makeup synthesis from a reference image, by learning a model that maps an example portrait image with makeup to the space of rendering parameters. This method can be used by artists to automatically create realistic virtual cosmetics image samples, or by consumers, to virtually try-on a makeup extracted from their favorite reference image.",

author = "Robin Kips and Ruowei Jiang and Sileye Ba and Edmund Phung and Parham Aarabi and Pietro Gori and Matthieu Perrot and Isabelle Bloch",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021 ; Conference date: 19-06-2021 Through 25-06-2021",

year = "2021",

month = jun,

day = "1",

doi = "10.1109/CVPRW53098.2021.00431",

language = "English",

series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",

publisher = "IEEE Computer Society",

pages = "3884--3888",

booktitle = "Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021",

}

Kips, R, Jiang, R, Ba, S, Phung, E, Aarabi, P, Gori, P, Perrot, M & Bloch, I 2021, Deep graphics encoder for real-time video makeup synthesis from example. in Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, IEEE Computer Society, pp. 3884-3888, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021, Virtual, Online, United States, 19/06/21. https://doi.org/10.1109/CVPRW53098.2021.00431

Deep graphics encoder for real-time video makeup synthesis from example. / Kips, Robin; Jiang, Ruowei; Ba, Sileye et al.
Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021. IEEE Computer Society, 2021. p. 3884-3888 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Deep graphics encoder for real-time video makeup synthesis from example

AU - Kips, Robin

AU - Jiang, Ruowei

AU - Ba, Sileye

AU - Phung, Edmund

AU - Aarabi, Parham

AU - Gori, Pietro

AU - Perrot, Matthieu

AU - Bloch, Isabelle

PY - 2021/6/1

Y1 - 2021/6/1

N2 - While makeup virtual-try-on is now widespread, parametrizing a computer graphics rendering engine for synthesizing images of a given cosmetics product remains a challenging task. In this paper, we introduce an inverse computer graphics method for automatic makeup synthesis from a reference image, by learning a model that maps an example portrait image with makeup to the space of rendering parameters. This method can be used by artists to automatically create realistic virtual cosmetics image samples, or by consumers, to virtually try-on a makeup extracted from their favorite reference image.

AB - While makeup virtual-try-on is now widespread, parametrizing a computer graphics rendering engine for synthesizing images of a given cosmetics product remains a challenging task. In this paper, we introduce an inverse computer graphics method for automatic makeup synthesis from a reference image, by learning a model that maps an example portrait image with makeup to the space of rendering parameters. This method can be used by artists to automatically create realistic virtual cosmetics image samples, or by consumers, to virtually try-on a makeup extracted from their favorite reference image.

UR - https://www.scopus.com/pages/publications/85116017685

U2 - 10.1109/CVPRW53098.2021.00431

DO - 10.1109/CVPRW53098.2021.00431

M3 - Conference contribution

AN - SCOPUS:85116017685

T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

SP - 3884

EP - 3888

BT - Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021

PB - IEEE Computer Society

T2 - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021

Y2 - 19 June 2021 through 25 June 2021

ER -

Kips R, Jiang R, Ba S, Phung E, Aarabi P, Gori P et al. Deep graphics encoder for real-time video makeup synthesis from example. In Proceedings - 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2021. IEEE Computer Society. 2021. p. 3884-3888. (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). doi: 10.1109/CVPRW53098.2021.00431

Deep graphics encoder for real-time video makeup synthesis from example

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this