SCORE! focuses on using these mappings as a creative tool: for instance to automatically generate a soundtrack to a piece of video. However, the methods we use have much broader applicability, for instance in information retrieval, e-humanities or general multimedia manipulation.
The MIDI-LD cloud is a vast archive of MIDI music, annotated and interlinked using Linked Data standards. We will aim to use this as our archive for the audio part of the project.
SCORE! now has a webpage. We are currently investigating the use of Variational Autoencoders for MIDI music, through several MSc student projects. We are also investigating the use of VAEs for the visual part of the project, starting with the Sound and Vision archive. More updates soon.
RE:VIVE, CC BY-SA 3.0 Cover image: DRs Kulturarvsprojekt CC BY-SA