A Modular Sound Descriptor Analysis Framework for Relaxed-real-time Applications

Diemo Schwarz (1) , Norbert Schnell (1)

1 Equipe Interactions musicales temps-réel

Audio descriptor analysis in real-time or in batch is increasingly important for advanced sound processing, synthesis, and research, often using a relaxed-real-time approach. Existing approaches mostly lack either modularity or flexibility, since the design of an efficient modular descriptor analysis framework for commonly used real-time environments is non-trivial. We first lay out the requirements for such a framework before describing our modular architecture that integrates instantaneous descriptors, segmentation modules, temporal modeling, converter modules, and external descriptors or meta-data. We present its proof of concept implementation in Max/MSP and examples that show the simplicity with which new analysis modules can be written.

Mots clés: Max; Sound Analysis; MSP; audio descriptors; descriptor extraction; real-time processing; modularity

Mots clés: Informatique musicale

Domaines: Son [cs.SD]; Interface homme-machine [cs.HC]; Musique, musicologie et arts de la scène; Traitement du signal et de l'image [eess.SP]; Apprentissage [cs.LG]; Intelligence artificielle [cs.AI]; Ingénierie assistée par ordinateur; Multimédia [cs.MM]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Autre [cs.OH]; Traitement du signal et de l'image [eess.SP]

Diemo Schwarz, Norbert Schnell. A Modular Sound Descriptor Analysis Framework for Relaxed-real-time Applications. International Computer Music Conference (ICMC), Jun 2010, New York, United States. pp.1-1. ⟨hal-01161252⟩