360 photography with ambisonic audio : import/view a 360 video of a pic in Reaper?

[Jazzooka]

Hi there Reaperees

Am pretty new to spatial audio. A colleague photographer had this idea of proposing virtual tours of his work with added audio/music that I would provide and mix.

He did a few 360 tours with VR-tours software some time ago where you can add either ambisonic files or mono/stereo objects to place where you want and export the tour.

But he would rather leave the audio to me, to place and mix it how I see fit.

As DAWs are timeline-based, importing just a 360 picture wouldn’t work.

So I thought of creating a 360 video from the picture, given a precise duration that the photographer would like and make/adapt the audio and music based on that duration.

Video questions : any idea on how to transform a 360 picture to a video and most importantly : what format, if any, could be imported by Reaper, while being able to see and audition the result prior to bouncing?

For instance, simplified : if a picture contains a river to the left side surround, with audio/music made for that side and the right side surround has a forest with its own audio/music : can you follow that around in Reaper from the video, either by moving the mouse on the video or do you need a HRTF tool or other?

Thanks for any info

Best

J

[plush2]

That sounds like a very fun project.

You can import an equirectangular projection image (jpeg, png etc.) into a Reaper track by dragging and dropping.

Once it is on the track you can extend it to the time length over which you want it to play.

Once in Reaper you need to put a video processor on the image track and select the "Equirectangular/spherical 360 panner" preset. This will allow you to view the image in a VR projection.

[Jazzooka]

Thank you very much Plush2 🙏

It is a very fun project, the photographer is a good friend, and he suggested not do "lifelike" inserts of sound, but go to various abstract or unexpected places soundwise, which leaves margin for fun

I will probably need to re-read a couple of times what you wrote as I am a newbie when it comes to spatial audio & video/photo.

Cheers!

J

Originally Posted by plush2

That sounds like a very fun project.

You can import an equirectangular projection image (jpeg, png etc.) into a Reaper track by dragging and dropping.

Once it is on the track you can extend it to the time length over which you want it to play.

Once in Reaper you need to put a video processor on the image track and select the "Equirectangular/spherical 360 panner" preset. This will allow you to view the image in a VR projection.