File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: CaricatureShop: Personalized and Photorealistic Caricature Sketching

TitleCaricatureShop: Personalized and Photorealistic Caricature Sketching
Authors
KeywordsFace
Three-dimensional displays
Solid modelingTwo dimensional displaysStrain
Solid modeling
Two dimensional displays
Issue Date2020
PublisherIEEE. The Journal's web site is located at http://www.computer.org/tvcg
Citation
IEEE Transactions on Visualization and Computer Graphics, 2020, v. 26 n. 7, p. 2349-2361 How to Cite?
AbstractIn this paper, we propose the first sketching system for interactively personalized and photorealistic face caricaturing. Input an image of a human face, the users can create caricature photos by manipulating its facial feature curves. Our system first performs exaggeration on the recovered 3D face model, which is conducted by assigning the laplacian of each vertex a scaling factor according to the edited sketches. The mapping between 2D sketches and the vertex-wise scaling field is constructed by a novel deep learning architecture. Our approach allows outputting different exaggerations when applying the same sketching on different input figures in term of their different geometric characteristics, which makes the generated results “personalized”. With the obtained 3D caricature model, two images are generated, one obtained by applying 2D warping guided by the underlying 3D mesh deformation and the other obtained by re-rendering the deformed 3D textured model. These two images are then seamlessly integrated to produce our final output. Due to the severe stretching of meshes, the rendered texture is of blurry appearances. A deep learning approach is exploited to infer the missing details for enhancing these blurry regions. Moreover, a relighting operation is invented to further improve the photorealism of the result. These further make our results “photorealistic”. The qualitative experiment results validated the efficiency of our sketching system.
Persistent Identifierhttp://hdl.handle.net/10722/284306
ISSN
2019 Impact Factor: 4.558
2015 SCImago Journal Rankings: 0.917

 

DC FieldValueLanguage
dc.contributor.authorHAN, X-
dc.contributor.authorHOU, K-
dc.contributor.authorDU, D-
dc.contributor.authorQIU, Y-
dc.contributor.authorCUI, S-
dc.contributor.authorZHOU, K-
dc.contributor.authorYu, Y-
dc.date.accessioned2020-07-20T05:57:40Z-
dc.date.available2020-07-20T05:57:40Z-
dc.date.issued2020-
dc.identifier.citationIEEE Transactions on Visualization and Computer Graphics, 2020, v. 26 n. 7, p. 2349-2361-
dc.identifier.issn1077-2626-
dc.identifier.urihttp://hdl.handle.net/10722/284306-
dc.description.abstractIn this paper, we propose the first sketching system for interactively personalized and photorealistic face caricaturing. Input an image of a human face, the users can create caricature photos by manipulating its facial feature curves. Our system first performs exaggeration on the recovered 3D face model, which is conducted by assigning the laplacian of each vertex a scaling factor according to the edited sketches. The mapping between 2D sketches and the vertex-wise scaling field is constructed by a novel deep learning architecture. Our approach allows outputting different exaggerations when applying the same sketching on different input figures in term of their different geometric characteristics, which makes the generated results “personalized”. With the obtained 3D caricature model, two images are generated, one obtained by applying 2D warping guided by the underlying 3D mesh deformation and the other obtained by re-rendering the deformed 3D textured model. These two images are then seamlessly integrated to produce our final output. Due to the severe stretching of meshes, the rendered texture is of blurry appearances. A deep learning approach is exploited to infer the missing details for enhancing these blurry regions. Moreover, a relighting operation is invented to further improve the photorealism of the result. These further make our results “photorealistic”. The qualitative experiment results validated the efficiency of our sketching system.-
dc.languageeng-
dc.publisherIEEE. The Journal's web site is located at http://www.computer.org/tvcg-
dc.relation.ispartofIEEE Transactions on Visualization and Computer Graphics-
dc.rightsIEEE Transactions on Visualization and Computer Graphics. Copyright © IEEE.-
dc.rights©20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.-
dc.subjectFace-
dc.subjectThree-dimensional displays-
dc.subjectSolid modelingTwo dimensional displaysStrain-
dc.subjectSolid modeling-
dc.subjectTwo dimensional displays-
dc.titleCaricatureShop: Personalized and Photorealistic Caricature Sketching-
dc.typeArticle-
dc.identifier.emailYu, Y: yzyu@cs.hku.hk-
dc.identifier.authorityYu, Y=rp01415-
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1109/TVCG.2018.2886007-
dc.identifier.pmid30575537-
dc.identifier.scopuseid_2-s2.0-85058889509-
dc.identifier.hkuros310936-
dc.identifier.volume26-
dc.identifier.issue7-
dc.identifier.spage2349-
dc.identifier.epage2361-
dc.publisher.placeUnited States-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats