SCORE! is a cooperation between the VU University Amsterdam, the Netherlands Institute for Sound and Vision’s RE:VIVE initiative and Lakker. Its aim is to use simple unsupervised analysis of audio and video, to create meaningful mappings between the two, through latent-space representations.

SCORE! focuses on using these mappings as a creative tool: for instance to automatically generate a soundtrack to a piece of video. However, the methods we use have much broader applicability, for instance in information retrieval, e-humanities or general multimedia manipulation.


The MIDI-LD cloud is a vast archive of MIDI music, annotated and interlinked using Linked Data standards. We will aim to use this as our archive for the audio part of the project.


19 April 2018

SCORE! now has a webpage. We are currently investigating the use of Variational Autoencoders for MIDI music, through several MSc student projects. We are also investigating the use of VAEs for the visual part of the project, starting with the Sound and Vision archive. More updates soon.

RE:VIVE falls under The Netherlands Institute for Sound and Vision's Privacy Statement