Vision-based effect modulation VST plugin
This project was created as part of a Bachelor's thesis at Charles University, titled: "A VST plugin for video-controlled audio manipulation".
VisiMusic is an effect plugin that applies audio modulation, configured based on a live video input. This creates unique soundscapes connected to visual content.
- Compatible with a broad scale of DAWs
- Creative control over what aspects of the media file get detected
- Works on all common image and video file types.
- Contains multiple signal processing effects, each mapped to a different visual feature
- Open source, with easy extendability & documentation on how to detect more features or add more effects
- Windows: 64-bit Windows 10 or later
- macOS: Apple Silicon (ARM64) macOS 11 or later
- 64-bit DAW with VST3 support
Binaries for both Windows and macOS are available for download in the Releases section.
For a description of the installation process and troubleshooting help visit this page.
This project is licensed under the GNU GPL v3. See the LICENSE file for full details.
The project uses the following libraries.
See the THIRD_PARTY_NOTICES file for details and licensing information.
To help you get started with using Visimusic, you can visit this page for a list of videos that have been used during testing and react with the plugin in interesting ways.
The videos are provided as download links to comply with the license of the provider - PixaBay.
- Detailed user guide
- Installation guide
- Full project documentation
- Thesis full text pdf