What inspired you to do this?
I was looking for a way to incorporate machine learning into some sort of interactive scenario where I could create generative output during a live performance and react to it in real time, essentially making it a collaborative performance between a person and a machine learning model.
How long did it take to make it?
The original version I made of this probably took about a week to code before I got a working prototype. I used that version for a while. I entered into a hackathon for machine learning and music and decided it was a good opportunity to try and improve upon the design, so it prob took another two weeks of coding to get the version I have now.
How long have you been doing things like this?
I've been working with Sonic Pi for almost 5 years and started messing around with machine learning in a musical context about 2 years ago.
How much did this cost to do?
100% open source. Didn't cost me anything but time.
Have you done other things like this?
I have made some other machine learning music projects but nothing that is interactive.
What did you wish you knew before you started this?
I had an earlier version of this project where I was able to make drum patterns in Sonic Pi then send them into the DrumRNN model and have them returned to Sonic Pi. It was a bit cumbersome having to go back and forth from Sonic Pi and the code for the original drumbeats was hard to keep track of. I also had to rely on data logged to the console to get any sense of what the output was like besides hearing it. The GUI made it much easier to use, so I wished I had been aware of the NexusUI library when I first started this.
Are there plans available to make this? Do you sell this?
See the Github for all the code: https://github.com/mrbombmusic/sonic-pi-drum-rnn-gui
I would like to try and do some live performances with it.
I have done a couple of live streams.
Session 1: https://youtu.be/Wi4WUCyiJ3w
Sonic Pi: https://sonic-pi.net/
Magenta.js intro: https://hello-magenta.glitch.me/
p5js OSC library: https://github.com/genekogan/p5js-osc