Old 07-06-2020, 11:24 AM   #1
EmeraldNotion
Human being with feelings
 
Join Date: Jan 2017
Posts: 10
Default How to write a custom video FX plugin

I'm working on creating some audio visualizations that would not be possible (or at least very difficult) with the Reaper built in Video Processor plugin. Is it possible to write a plugin to process video for Reaper? The ideal would be something like a way to make a VST for video so I can take advantage of Reaper's built in video preview, encoding, and automation tools while allowing me to focus on the visualization aspect.
EmeraldNotion is offline   Reply With Quote
Old 07-07-2020, 09:55 AM   #2
Bingo Bongo
Human being with feelings
 
Join Date: Feb 2011
Posts: 14
Default

I don’t know. Do you actually know how to write code, or are you trying to do this using the WinkieDinky™ scripting language?

If you’re on Windows you may be able to write some sort of Direct Media Object (DMO) or a DirectShow transform filter. So the first question I would ask is if Reaper’s video playback engine is based on DirectShow.

If the answer is ‘yes’ then the next question becomes how to gain assess to the IGraphBuilder Interface.
Bingo Bongo is offline   Reply With Quote
Old 07-07-2020, 10:24 AM   #3
EmeraldNotion
Human being with feelings
 
Join Date: Jan 2017
Posts: 10
Default

I've worked on video processing workloads quite a bit in the past. I'll probably mostly be doing this in C++ unless there is something more quirky I'll need to access video. I've worked with DirectShow a bit, but it's been a while and I'll have to brush up if that's what Reaper is using.

Is there any information out there about how video is implemented in Reaper? Ideally I would like to route audio, video, and automation to my plugin similar to what is possible with the native Reaper video processor plugin. The audio and automation parts are easy enough to handle with a VST plugin, but I'm not sure if there is a way to access the video stream within a VST.

Any documentation or open source examples of someone else working with video in Reaper would be greatly appreciated!
EmeraldNotion is offline   Reply With Quote
Old 07-07-2020, 01:26 PM   #4
EpicSounds
Human being with feelings
 
EpicSounds's Avatar
 
Join Date: Jul 2009
Posts: 7,568
Default

5.20 update

Video: add extensions to allow VST plug-ins access to video


this is all I could find
__________________
REAPER Video Tutorials, Tips & Tricks and more at The REAPER Blog
EpicSounds is offline   Reply With Quote
Old 07-07-2020, 01:31 PM   #5
EmeraldNotion
Human being with feelings
 
Join Date: Jan 2017
Posts: 10
Default

Nice, thanks EpicSounds.

I guess that's enough where I could at least try building a VST and seeing if there's any inputs that look like they might be providing what I need.
EmeraldNotion is offline   Reply With Quote
Old 07-08-2020, 03:40 PM   #6
Meo-Ada Mespotine
Human being with feelings
 
Meo-Ada Mespotine's Avatar
 
Join Date: May 2017
Location: Leipzig
Posts: 6,621
Default

All I ever could find was two header-files on Justin's server:

https://landoleet.org/dev/video_processor.h - some comments included
https://landoleet.org/dev/video_frame.h - no comments at all
__________________
Use you/she/her.Ultraschall-Api Lua Api4Reaper - Donate, if you wish

On vacation for the time being...
Meo-Ada Mespotine is offline   Reply With Quote
Old 07-08-2020, 05:05 PM   #7
EmeraldNotion
Human being with feelings
 
Join Date: Jan 2017
Posts: 10
Default

That's a great find! Looks like I'll have to do some reverse engineering, but that mostly seems to make sense.
EmeraldNotion is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 05:15 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.