🎤 Case study: Interphase - a deeper look at building an interactive music generator with physical lighting
Justin's examples of different audio uses in creative code
- Interphase
- Interphase preview
- Interactive music generator software w/physical lighting
- #dancelab @ DAM
- All choreography & computer-generated visuals were synced to the tempo of the music
- Bauhouse
- Graphics respond to audio triggering (built w/Interphase music engine)
- Feetboxin
- Piezo (impact) sensors send MIDI signals that trigger audio, but also are turn into DMX signals to trigger the lights
- HaxVisual
- Incoming audio signal is analysed and used to draw audio-reactive images
- Obsidian
- Looping animation was matched exactly to the length of the looping audio track
- Webcam sonification
- Using pixel data to translate into a looping sound wave
Samples vs. Synthesis
- Samples
- Synthesis
Making music
- Basic building blocks
- Data & timing to create "sequencer" patterns (author info)
- Notes, chords & scales
- Algorithmic Music Composition - interactive tutorial in p5js
- Generative Music AI Course - YouTube series
- Changing parameters over time
- Tools
- Examples
- More examples of web-based music tools
Audio input
- FFT analysis from microphone input
- Amplitude analysis from sound file
- More demos
- Specific example: Realtime pitch detection
Other tools for creating music with code
- Live coding
- Max
- Supercollider
- Aubio
- Sound eXchange (cli conversion tool, like ffmpeg but for audio files)
- JUCE
- VCV Rack (+ plugin docs)
- Ableton Live Connection Kit
Read:
- Introduction to Generative Music
- Algorithmic Music Composition - interactive tutorial in p5js
- Algorithmic Music @ Wikipedia
- Live Coding Handbook
- Advanced articles (optional, just for kicks)
Watch & listen:
- Making Music with CODE?! (With DJ_Dave and Sam Aaron)
- Tutorials
- "The Code Creative" Web Audio API video tutorials
- Luisa Pereira's classes
- Conceptual interviews
- Art examples
- Simon Russell - Beat Visualization
- The Ballad of the Psychotropic Robots
- Ryoji Ikeda | data.path
- William Fields - Fields OS
- "FieldsOS is 100% algorithmic music. The probabilities, conditions, and constraints were configured in advance. The output was recorded and this is the result. No curation or editing was done."
Build something with audio
- Ideas:
- Write a program that plays a sound file along with a graphical element
- Build an interactive or self-playing instrument
- Visualize microphone or audio file analysis
- Synthesize some sounds with oscillators
- Build a drum pad/machine like Bongo.cat
- Use MIDI
- Resources: Free audio files
- Resources: Wave editors (record & edit your own audio files)
- Audacity (Tenacity) (free desktop app)
- Wavacity (free browser-based app)
- AudioMass (free browser-based app)
- Present your data visualizations