Title:
AUTOMATIC OPERATOR FUSION METHOD FOR COMPUTATIONAL GRAPH AND RELATED PRODUCT
Document Type and Number:
WIPO Patent Application WO/2024/093292
Kind Code:
A1
Abstract:
An automatic operator fusion method for a computational graph. The method comprises: determining control data affecting operator fusion performance; for hardware information of a computing device of a computational graph to be executed, generating different control data samples according to the control data; applying the control data samples to compute the fusion income of candidate fusion sub-graphs corresponding to different control data samples; determining an optimal fusion mode according to the fusion income, performing compilation optimization on the computational graph on the basis of the optimal fusion mode to obtain a corresponding binary instruction sequence, and allocating the binary instruction sequence to the computing device to execute a task corresponding to the computational graph.
Inventors:
WU LINGDONG (CN)
YANG YUNZHAO (CN)
DENG LONG (CN)
YANG YUNZHAO (CN)
DENG LONG (CN)
Application Number:
PCT/CN2023/103286
Publication Date:
May 10, 2024
Filing Date:
June 28, 2023
Export Citation:
Assignee:
SHANGHAI CAMBRICON INF TECH CO LTD (CN)
International Classes:
G06F8/41; G06F9/50; G06F16/901; G06N3/04; G06N3/08
Foreign References:
| CN115756478A | 2023-03-07 | |||
| CN110321999A | 2019-10-11 | |||
| CN114358261A | 2022-04-15 | |||
| CN114692860A | 2022-07-01 | |||
| CN112965710A | 2021-06-15 |
Attorney, Agent or Firm:
VCAN IP LAW FIRM (CN)
Download PDF: