Music in the AI Era: 15th International Symposium, CMMR 2021, Virtual Event, November 15–19, 2021, Revised Selected Papers (Lecture Notes in Computer Science)

This book constitutes the refereed proceedings and revised selected papers from the 15th International Symposium on Music in the AI Era, CMMR 2021, which took place during November 15–19, 2021 as a virtual event. The 24 full papers included in this book were carefully reviewed and selected from 48 submissions. The papers are grouped in thematical sessions on Music technology in the IA era; Interactive systems for music; Music Information Retrieval and Modeling; and Music and Performance Analysis. Preface Organization Contents Music Technology in the IA Era KANSEI Informatics and Music Technology in AI Era 1 Introduction 2 New Trend of Technology Development 3 KANSEI Informatics 4 AI and Music Technology 5 Conclusions References On Parallelism in Music and Language: A Perspective from Symbol Emergence Systems Based on Probabilistic Generative Models 1 Introduction 2 Language Acquisition and Music Composition Using PGMs 2.1 Multimodal Concept Formation and Lexical Acquisition in Robotics 2.2 Automatic Music Composition in Computers 3 Symbol Emergence Systems and Emergence of Semiotic Meanings 3.1 Symbol Emergence Systems 3.2 Collective Predictive Coding 4 On Parallelism in Music and Language 4.1 Parallelism on Syntax, Brain and Evolution 4.2 Symbol Emergence Systems on Music, Emotion, and Interoception 5 Conclusion References WaVAEtable Synthesis 1 Introduction 1.1 Motivation and Project Overview 1.2 Related Methods 2 WaVAEtable Synthesis 2.1 Sample Neural Network Architecture and Training 2.2 Wavetable Generation 2.3 Synthesizer Implementations 2.4 Incorporation of Existing Timbral Autoencoders 3 Future Work and Conclusion References Deep Learning-Based Music Instrument Recognition: Exploring Learned Feature Representations 1 Introduction 2 Attention-Based Model 2.1 Input Pre-processing 2.2 1st Stage: Post-processing and Representation 2.3 2nd Stage: CNN, Attention Mechanism and Classification 3 Datasets 4 Experimental Procedure 4.1 1st Stage: Pre-Training Objectives 4.2 2nd Stage: Downstream Instrument Recognition 5 Evaluation 6 Results and Discussion 6.1 Representation Post-processing: Impact on Performance 6.2 Learned Representations: Impact on Performance 7 Conclusions References Time-Span Tree Leveled by Duration of Time-Span 1 Introduction 2 Implementation Problems of Melodic-Morphing Algorithm 2.1 Ideas of Melodic Morphing 2.2 Partial Melody Reduction 2.3 Combining Two Melodies 2.4 Implementation Problems of Melodic-Morphing Algorithm 3 Implementation Problems of Deep-learning-based Time-Span Tree Analyzer 4 Solution: Time-Span Tree Leveled by Duration of Time Span 4.1 Automatic Melodic Morphing 4.2 Automatic Time-Span Tree Analysis by Deep Learning 5 Experiment and Results 5.1 Automating Melodic Morphing by Prioritization of Branches 5.2 Comparison of Seq2Seq and Transformer in Stepwise Time-Span Reduction 6 Conclusion References Evaluating AI as an Assisting Tool to Create Electronic Dance Music 1 Introduction 2 Related Work 3 Environment Setup and AI-Created Music 4 Test Structure and Efficiency Evaluation 4.1 Structure 4.2 Evaluation 5 Listening Evaluation 6 Summary and Conclusion References Interactive Systems for Music Suiview: A Web-Based Application that Enables Users to Practice Wind Instrument Performance 1 Introduction 2 Basic Design and Functions 2.1 Recording 2.2 Visualizing the Acoustic Characteristics 2.3 Visualizing the Recording-by-Recording Variations in the Stability 2.4 Teacher-to-Student Comment 3 Trial Use 4 Conclusion References Continuous Parameter Control Using an On/Off Sensor in the Augmented Handheld Triangle 1 Introduction 2 Instrument Design 2.1 Triaume Body 2.2 Smartphone 2.3 Computer 3 Instrument Evaluation 3.1 On/Off Sensor 3.2 Impact of Insulating Tape in the Acoustic Instrument Sound 3.3 PWM-Like Control 4 Discussion 5 Conclusion References Networked and Collaborative Musical Play Amongst Humans and Virtual Biological Agents in Locus Diffuse 1 Introduction 2 Related Works and Literature Review 2.1 Harnessing Biology - Artistic and Computational Implementations 2.2 Sonic and Performance Ecosystems 2.3 Multi-user Instruments and Networked Music 3 Artistic Intention and System Overview 3.1 Simulated Agents 3.2 Sonification 3.3 Networked Interaction and Visualization 4 Survey 5 Responses and Analysis 5.1 Perception of the System 5.2 Narrative and Interaction 5.3 Visual vs. Sonic Characterization of the System 5.4 Connection 6 Conclusions and Future Work References Towards an Aesthetic of Hybrid Performance Practice*12pt 1 Introduction 2 Performance Approach 1: People in the Dunes 3 Performance Approach 2: IDE-Fantasy 3.1 Preparation and Realisations 3.2 Software Architecture and Design Principles 4 Methodolody, Design Considerations, Discussion 5 Conclusions, Future Work References Development of Audio Descriptors Inspired by Schaefferian Criteria: A Set of Tools for Interactive Exploration of Percussive Sounds 1 Introduction 2 Fundaments of Schaeffer's Solfège 3 Audio Descriptors: Selection, Implementation, and Parametrization 3.1 Time Series Analysis 4 Practical Applications 4.1 Anesidora, for Percussion and Live-Electronics 4.2 Differentiation of Attacks on the Flute 4.3 Improvisation with a Frog-Guiro 5 Final Remarks References A Polytemporal Model for Musical Scheduling 1 Introduction 2 Abstract Timescales 3 Time Transformations 3.1 Differential Equation Formulation 4 Tempo Curves Integration 4.1 Integration of Constant and Linear Tempo Curves 4.2 Parametric Tempo Curves 4.3 Bézier Tempo Curves 4.4 Multi-segment Curves Implementation 5 Phase Synchronization 5.1 Catch-Up Curves 6 Scheduler 6.1 Scheduler API 6.2 Scheduler's Operation 7 Conclusion and Future Work References Interaction Strategies in Composition for Karlax and Acoustic Instruments 1 Introduction 2 Analysis of the Pieces 2.1 Sound Synthesis and Mapping Strategies 3 Composition Models 4 Interaction Metaphors from Computer Music 5 Composing with Interaction Strategies 6 Discussion 7 Conclusion and Future Work References Music Information Retrieval and Modeling Modelling Moral Traits with Music Listening Preferences and Demographics 1 Introduction 2 Data Collection and Feature Engineering 3 Experiments and Results 4 Discussions and Conclusions References Classification of 1950 to 1960 Electronic Music Using the VGGish Neural Network and Random Forest 1 Introduction 1.1 Analysis and Systematization of Electronic Music 1.2 Electronic Music in the 1950s: Musique Concrète and Elektronische Musik 1.3 Method 1.4 Results 1.5 Conclusion References Knowledge Transfer from Neural Networks for Speech Music Classification 1 Introduction 2 Related Work 3 Datasets 4 Methodology 4.1 Network Architectures 4.2 Input Representation 4.3 Implementation Details and Metrics 4.4 Transfer Learning Networks and Tasks 5 Results 5.1 Network Architectures Comparison 5.2 Transfer Learning 6 Conclusions References Predominant Instrument Recognition in Polyphonic Music Using Convolutional Recurrent Neural Networks 1 Introduction 1.1 Related Work 1.2 Motivation 2 System Description 3 Feature Extraction 4 Model Architectures 5 Performance Evaluation 5.1 Dataset 5.2 Data Augmentation Using WaveGAN 5.3 Experimental Set-Up 6 Results and Analysis 7 Conclusion References The Matrix Profile for Motif Discovery in Audio - An Example Application in Carnatic Music 1 Introduction and Related Work 2 Dataset 3 Methodology 3.1 Predominant Pitch Extraction 3.2 Repeated Motif Discovery 4 Results 5 Discussion 6 Further Work 7 Conclusion References A Rule-Based Method for Implementing Implication-Realization Model 1 Introduction 2 Implementation Method of Melodic Analyzer 2.1 Closure 2.2 Closure Estimation Based on Inter-onset Interval 2.3 Transition of Pitch 2.4 Beat Structure 2.5 Feature Integration 3 Symbol Assignment 3.1 Previous Symbol-Assignment Method and Actual Data 3.2 Detailed Rules for the I-R Symbol Assignment 4 Experiment 4.1 Evaluation Values and Dataset 4.2 Training Data 4.3 Evaluation Results 5 Concluding Remarks References Music and Performance Analysis CROCUS: Dataset of Critique Documents of Musical Performance 1 Introduction 2 Related Work 2.1 Music Database for Research 2.2 Teaching Behavior on Musical Performance Lesson 3 Method 3.1 Constructing CROCUS Dataset 3.2 Annotating Types of Sentences in CROCUS 3.3 Evaluating Perceived Utility of Critique Documents 4 Results 4.1 Constructing CROCUS Dataset 4.2 Annotating Types of Sentences in CROCUS 4.3 Evaluating Perceived Utility of Critique Documents 5 Discussion 6 Conclusion References A Psychoacoustic-Based Methodology for Sound Mass Music Analysis 1 Introduction 2 Theoretical Background 2.1 Ligeti's Concepts of Timbre of Movement and Permeability 2.2 First Movement of the Ten Pieces for Wind Quintet 2.3 Audio Descriptors 3 Methodology 3.1 The Workflow 3.2 The Musicological Significance of the Chosen Audio Descriptors 3.3 Technical Audio Analysis Parameters 4 Results and Discussion 5 Conclusion References Musical Structure Analysis and Generation Through Abstraction Trees 1 Introduction 1.1 Related Work 2 Representations 3 Analysis 3.1 Regularity Detection Within a Corpus 3.2 Genre Discrimination 4 Generation 4.1 Corpus Analysis and Generation of Melodic Beginning 4.2 Generation of a Pool of Continuations 4.3 Genetic Approach to Select Continuation 4.4 Example Results 5 Conclusions References Analysis of Musical Dynamics in Vocal Performances 1 Introduction 2 Background and Related Work 2.1 Loudness Measurement Scales 2.2 Dynamics in Music Information Retrieval 3 Methodology 4 Experiments 4.1 Data Curation 4.2 Experimental Setup 4.3 Results 4.4 Influence of Voice Source Separation on Loudness Computation 5 Discussion 6 Conclusion and Future Work References With Love: Electroacoustic, Audiovisual, and Telematic Music 1 Electroacoustic Music 2 Electroacoustic Music Composition 3 Language, Speech, and Electroacoustic Sound 4 Sound Embodiment and Sound Space 5 Audiovisual Composition 6 The Electronic Music Video 7 From Soundscape to Telematic Immersion 8 Conclusion: Telematic Embrace References Author Index