Conference Publication Details
Mandatory Fields
Stephen Roddy, Brian Bridges
The International Conference on Auditory Display
The Design of a Smart City Sonification System using a Conceptual Blending and Musical Framework, Web Audio and Deep Learning Techniques
Optional Fields
Auditory Display, Sonification, Smart Cities, Artificial Intelligence, Machine Learning, IoT, Internet of Things, Smart Cities, Human-computer Interaction, Data Analytics,
This paper describes an auditory display system for smart city data for Dublin City, Ireland. It introduces and describes the different layers of the system and outlines how they operate individually and interact with one another. The system uses a deep learning model called a variational autoencoder to generate musical content to represent data points. Further data-to-sound mappings are introduced via parameter mapping sonification techniques during sound synthesis and post-processing. Conceptual blending and music theory provide frameworks, which govern the design of the system. The paper ends with a discussion of the design process that contextualizes the contribution, highlighting the interdisciplinary nature of the project, which spans data analytics, music composition and human-computer interaction.
Grant Details