Title:
DATA PROCESSING METHOD, AND APPARATUS
Document Type and Number:
WIPO Patent Application WO/2024/082693
Kind Code:
A1
Abstract:
The present application belongs to the technical field of databases. Disclosed are a data processing method, and an apparatus. An analytical processing engine acquires incremental data from a transactional processing engine. The analytical processing engine updates a storage list according to the incremental data. The storage list has a columnar storage format. The storage list comprises a data information column and a validity indication information column. The incremental data is stored in the data information column in the form of data rows. The validity indication information column is used for indicating that the data rows in the data information column are valid or invalid. On the basis of the validity indication information column, the analytical processing engine may filter out invalid data rows in the data information column so as to read valid data rows in the data information column, thus implementing rapid data deduplication. The validity indication information column has a small data volume and the data validity can be updated rapidly, saving storage resources and improving the data timeliness.
Inventors:
KANG XIANG (CN)
SONG LIYONG (CN)
LIN RUOLIN (CN)
BAKKEN STIG (CN)
HUMBORSTAD RUNE (CN)
SONG LIYONG (CN)
LIN RUOLIN (CN)
BAKKEN STIG (CN)
HUMBORSTAD RUNE (CN)
Application Number:
PCT/CN2023/103426
Publication Date:
April 25, 2024
Filing Date:
June 28, 2023
Export Citation:
Assignee:
HUAWEI CLOUD COMPUTING TECH CO LTD (CN)
International Classes:
G06F16/23
Foreign References:
| CN110019251A | 2019-07-16 | |||
| CN113010608A | 2021-06-22 | |||
| CN113874852A | 2021-12-31 | |||
| CN115114344A | 2022-09-27 |
Attorney, Agent or Firm:
BEIJING SAN GAO YONG XIN INTELLECTUAL PROPERTY AGENCY CO., LTD. (CN)
Download PDF: