Nothing Special   »   [go: up one dir, main page]

Song et al., 2021 - Google Patents

Half‐body Portrait Relighting with Overcomplete Lighting Representation

Song et al., 2021

View PDF
Document ID
1376319451645916502
Author
Song G
Cham T
Cai J
Zheng J
Publication year
Publication venue
Computer Graphics Forum

External Links

Snippet

We present a neural‐based model for relighting a half‐body portrait image by simply referring to another portrait image with the desired lighting condition. Rather than following classical inverse rendering methodology that involves estimating normals, albedo and …
Continue reading at guoxiansong.github.io (PDF) (other versions)

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46Extraction of features or characteristics of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding, e.g. from bit-mapped to non bit-mapped
    • G06T9/001Model-based coding, e.g. wire frame
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62Methods or arrangements for recognition using electronic means
    • G06K9/6201Matching; Proximity measures
    • G06K9/6202Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects

Similar Documents

Publication Publication Date Title
Yamaguchi et al. High-fidelity facial reflectance and geometry inference from an unconstrained image
Lattas et al. AvatarMe: Realistically Renderable 3D Facial Reconstruction" in-the-wild"
Tewari et al. State of the art on neural rendering
Deschaintre et al. Flexible svbrdf capture with a multi‐image deep network
Kirschstein et al. Nersemble: Multi-view radiance field reconstruction of human heads
Wang et al. Morf: Morphable radiance fields for multiview neural head modeling
Zhou et al. Adversarial Single‐Image SVBRDF Estimation with Hybrid Training
Cai et al. FCSR-GAN: Joint face completion and super-resolution via multi-task learning
Kronander et al. Photorealistic rendering of mixed reality scenes
Einabadi et al. Deep neural models for illumination estimation and relighting: A survey
Griffiths et al. OutCast: Outdoor Single‐image Relighting with Cast Shadows
CN111951368B (en) Deep learning method for point cloud, voxel and multi-view fusion
Galteri et al. Deep 3d morphable model refinement via progressive growing of conditional generative adversarial networks
Yeh et al. Photoscene: Photorealistic material and lighting transfer for indoor scenes
Wu et al. Specular-to-diffuse translation for multi-view reconstruction
Papantoniou et al. Relightify: Relightable 3d faces from a single image via diffusion models
Sharma et al. Nighttime stereo depth estimation using joint translation-stereo learning: Light effects and uninformative regions
Zhang et al. Video-driven neural physically-based facial asset for production
Roessle et al. Ganerf: Leveraging discriminators to optimize neural radiance fields
Zhou et al. Photomat: A material generator learned from single flash photos
Yang et al. Towards practical capture of high-fidelity relightable avatars
Zeng et al. Joint 3D facial shape reconstruction and texture completion from a single image
Sarkar et al. LitNeRF: Intrinsic Radiance Decomposition for High-Quality View Synthesis and Relighting of Faces
Rodriguez-Pardo et al. Neural photometry-guided visual attribute transfer
Song et al. Half‐body Portrait Relighting with Overcomplete Lighting Representation