Neural Notes: An Online Platform for Real-Time Structured Musical Improvisation Supporting Human-Human, Human-AI, and AI-AI Interaction

Read full text
Authors: Mike Hao Jiang, Andrew Lippman
Cited by: 0
References: 6

Abstract

Neural Notes is an online platform for real-time structured musical improvisation supporting human–human, human–AI, and AI–AI interaction. The system supports real-time improvisatory exchange with low perceived latency, situated within a structured harmonic environment defined by user-selected songs. The platform runs in any modern web browser and supports both MIDI-enabled instruments and computer keyboard input, making it widely accessible to musicians of all levels. Neural Notes provides a unified environment for co-creative musical interaction, offering researchers a living testbed for studying improvisational dynamics, AI-assisted practice, and multi-agent musical collaboration. In this demo, we showcase all three interaction modes and highlight how the platform enables responsive musical dialogue between humans and AI agents, serving as both a creative tool and a foundation for future research in algorithmic music composition and intelligent interactive music systems.

Fields of Study & Subjects

Music Technology and Sound Studies Musicology and Musical Analysis Music and Audio Processing

Publication details

Journal / source
ACM International Conference on Intelligent User Interfaces (IUI)
Pages
189–192
Publication date
9 March 2026
Language
EN