A living picture that visualizes music in collaboration with AI

Machine learning researcher Xander Steenbrugge has created a new audiovisual experience where humans and AI work together. The various paintings created by AI in line with the music are beautiful as if they were drawn by artists, but there are also nightmares mixed up.

The developer first determined the visual style for the theme of the picture drawn by AI, collected the painting dataset, and trained it on the algorithm. In line with this visual style, AI created a new video that mimics painting over several days. Also, the music was turned on and information could be added to the music.

This is an AI that continues to create unique pictures in music. The developer arranged and synthesized it to create the final work. You can see the music visualized by AI and humans.