Title:
MUSICAL SOUND SYNTHESIS METHOD, MUSICAL SOUND SYNTHESIS SYSTEM, AND PROGRAM
Document Type and Number:
WIPO Patent Application WO/2024/089995
Kind Code:
A1
Abstract:
A musical sound synthesis system 100 comprises: a control data acquisition unit 21 that acquires a time series X of control data indicating the condition of a target musical sound; a control vector generation unit 24 that generates a control vector V representing the feature of temporal change of timbre in response to an instruction from a user; a control vector processing unit 25 that generates a first parameter set Pn from the control vector V; and a musical sound synthesis unit 22 that generates a time series Z of acoustic data representing the acoustic feature quantity of the target musical sound by processing the time series X of the control data by a trained first generative model 30 including a plurality of basic layers and one or more intermediate layers and having learned the relation between the condition of the musical sound and the acoustic feature quantity of the musical sound. A first intermediate layer out of the one or more intermediate layers executes processing in which the first parameter set Pn is applied to data to be inputted to the first intermediate layer, and outputs the data after the application to the next layer.
Inventors:
SAINO KEIJIRO (JP)
COLONEL JOSEPH T (GB)
COLONEL JOSEPH T (GB)
Application Number:
PCT/JP2023/030522
Publication Date:
May 02, 2024
Filing Date:
August 24, 2023
Export Citation:
Assignee:
YAMAHA CORP (JP)
International Classes:
G10L13/00; G10L13/033; G10L13/06
Foreign References:
| JP2022122706A | 2022-08-23 | |||
| JP2022065566A | 2022-04-27 |
Other References:
阿久井駿 他, ”大規模主観評価に基づく定量的音読スキル情報を活用したDNN音声合成の検討”, 電子情報通信学会技術研究報告, 24 February 2021, vol. 120, no. 398, pp. 68-73, (AKUI, Shun et al. Investigation of DNN-based speech synthesis utilizing oral reading skills obtained from large scale subjective evaluation. IEICE Technical Report.)
Download PDF: