Hybrid Concatenative Synthesis On The Intersection of Music and Speech

Grégory Beller (1, 2) , Diemo Schwarz (1, 2) , Thomas Hueber (1, 2) , Xavier Rodet (1, 2)

1 Analyse et synthèse sonores [Paris]
2 Equipe Interactions musicales temps-réel

In this paper, we describe a concatenative synthesis sys- tem which was first designed for a realistic synthesis of melodic phrases. It has since been augmented to become an experimental TTS (Text-to-Speech) synthesizer. To- day, it is able to realize hybrid synthesis involving speech segments and musical excerpts coming from any record- ing imported in its database. The system can also synthe- size sentences with different voices, sentences with mu- sical sounds, melodic phrases with speech segments and generate compositional material from specific intonation patterns using a prosodic pattern extractor.

Mots clés: Unit; Selection; Sing; Concatenative; Hybrid; prosody; speech; music; violin; voice; synthesis; Corpus based

Mots clés: Informatique musicale

Domaines: Acoustique [physics.class-ph]; Traitement du signal et de l'image [eess.SP]; Musique, musicologie et arts de la scène; Neurosciences; Son [cs.SD]; Interface homme-machine [cs.HC]; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]

Grégory Beller, Diemo Schwarz, Thomas Hueber, Xavier Rodet. Hybrid Concatenative Synthesis On The Intersection of Music and Speech. Journées d'Informatique Musicale, Association Française d'Informatique Musicale; Centre de recherche en Informatique et Création Musicale, Jun 2005, Paris, France. pp.41-45. ⟨hal-01161411⟩