Face Illumination Manipulation using a Single
Reference Image by Adaptive Layer Decomposition

Xiaowu Chen, Hongyu Wu, Xin Jin and Qinping Zhao

Abstract

   This article proposes a novel image-based framework to manipulate the illumination of human face through adaptive layer decomposition. According to our framework, only a single reference imag e, without any knowledge of the 3D geometry or material information of the input face, is needed. To transfer illumination effects of a reference face image to a normal lighting face, we first decompose the lightness layers of the reference and the input images into large-scale and detail layers through  Least Squares (WLS) filter with adaptive smoothing parameters according to the gradient values of the face images. The large-scale layer of the reference image is filtered with the guidance of the input image by Guided Filter with adaptive smoothing parameters according to the face structures. The relit result is obtained by replacing the largescale layer of the input image with that of the reference image. To normalize the illumination effects of a non-normal lighting face (i.e. face delighting), we introduce Similar Reflectance Prior (SRP) to the layer decomposition stage by WLS filter, which make the normalized result less affected by the high contrast light and shadow effects of the input face. Through the above two procedures, we can change the illumination effects of a nonnormal lighting face by first normalizing the illumination and then transferring the illumination of another reference face to it. We acquire convincing relit results of both face relighting and delighting on numerous input and reference face images with various illumination effects and genders. Comparisons with previous works show that our framework is less affected by geometry differences and can preserve better the identification  structure and skin color of the input face.

Citation

Xiaowu Chen, Hongyu Wu, Xin Jin and Qinping Zhao.Face Illumination Manipulation using a Single Reference Image by Adaptive Layer Decomposition,IEEE Transations on Image Processing-submission,2013 PDF

Xiaowu Chen, Mengmeng Chen, Xin Jin and Qinping Zhao.Face Illumination Transfer through Edge-preserving Filters PDF