Title:
OCCLUSION SEGMENTATION-BASED THREE-DIMENSIONAL FACE RECONSTRUCTION METHOD AND SYSTEM
Document Type and Number:
WIPO Patent Application WO/2024/082950
Kind Code:
A1
Abstract:
Embodiments of the present application provide an occlusion segmentation-based three-dimensional face reconstruction method and system. The technical solution provided by the embodiments of the present application comprises: inputting a target face image into a pre-constructed parameter prediction model, the parameter prediction model comprising an image feature extractor and an image segmentation decoder, and the parameter prediction model being trained on the basis of a plurality of face training images, face key point information of the face training images, and a face occlusion segmentation area until an association loss function of the image feature extractor and the image segmentation decoder reaches a set state; and then outputting target face reconstruction parameters and a target face occlusion area of the target face image on the basis of the parameter prediction model, and performing three-dimensional face reconstruction post-processing on the basis of the face reconstruction parameters and the face occlusion segmentation area. By using the described technical means, the occupation of computing resources by model deployment can be reduced, the redundancy of a model can be reduced, the amount of computation of the model can be reduced, and three-dimensional face reconstruction efficiency can be improved.
More Like This:
Inventors:
WANG YEJIAO (CN)
YOHANES YUDHI ADIKUSUMA (SG)
YOHANES YUDHI ADIKUSUMA (SG)
Application Number:
PCT/CN2023/122322
Publication Date:
April 25, 2024
Filing Date:
September 27, 2023
Export Citation:
Assignee:
GUANGZHOU BAIGUOYUAN INF TECH CO LTD (CN)
International Classes:
G06T17/00
Domestic Patent References:
| WO2022143645A1 | 2022-07-07 | |||
| WO2022078041A1 | 2022-04-21 |
Foreign References:
| CN115619933A | 2023-01-17 | |||
| CN114399590A | 2022-04-26 | |||
| CN110443883A | 2019-11-12 | |||
| CN114723884A | 2022-07-08 | |||
| US20210225088A1 | 2021-07-22 | |||
| CN114972619A | 2022-08-30 | |||
| CN112580567A | 2021-03-30 | |||
| CN114399814A | 2022-04-26 | |||
| CN114862697A | 2022-08-05 | |||
| US20210358212A1 | 2021-11-18 | |||
| CN114898034A | 2022-08-12 | |||
| CN115131194A | 2022-09-30 |
Attorney, Agent or Firm:
BEIJING ZFANG PATENT AGENCY (CN)
Download PDF: