Title:
IMAGE PROCESSING MODEL TRAINING METHOD AND APPARATUS, ELECTRONIC DEVICE, COMPUTER PROGRAM PRODUCT, AND COMPUTER STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2024/087858
Kind Code:
A1
Abstract:
Provided in the present application are an image processing model training method and apparatus, an electronic device, and a storage medium. The method comprises: acquiring a plurality of multi-modal images used as training samples, the types of the multi-modal images comprising a full-modal image type and a missing-modal image type; on the basis of each multi-modal image, calling an initialized image processing model to execute a first training task for reconstructing a full-modal image, during the process of executing the first training task, the image processing model outputting a reconstructed first full-modal image; on the basis of the full-modal image, performing image inpainting processing on each reconstructed first full-modal image to obtain a full-modal template image; determining the consistency loss between a multi-modal image pair and the full-modal template image; and, on the basis of each multi-modal image, calling a trained image processing model to perform a second training task for segmenting each multi-modal image, the second training task using the consistency loss as a constraint condition.
Inventors:
LIU HONG (CN)
WEI DONG (CN)
LU DONGHUAN (CN)
WANG LIANSHENG (CN)
ZHENG YEFENG (CN)
WEI DONG (CN)
LU DONGHUAN (CN)
WANG LIANSHENG (CN)
ZHENG YEFENG (CN)
Application Number:
PCT/CN2023/115191
Publication Date:
May 02, 2024
Filing Date:
August 28, 2023
Export Citation:
Assignee:
TENCENT TECH SHENZHEN CO LTD (CN)
International Classes:
G06T5/00; G06T7/10
Foreign References:
| CN115170401A | 2022-10-11 | |||
| CN114911778A | 2022-08-16 | |||
| CN115115049A | 2022-09-27 | |||
| CN114283151A | 2022-04-05 | |||
| US20200311467A1 | 2020-10-01 |
Other References:
HONG LIU: "M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities", ARXIV, 9 March 2023 (2023-03-09), XP093163920, Retrieved from the Internet
Attorney, Agent or Firm:
CHINA PAT INTELLECTUAL PROPERTY OFFICE (CN)
Download PDF: