[Idea] 360 Video

[frink]

This is a harebrained idea that I don't have time to do but might make a good Sokol sample. (Or even full app...)

BACKSTORY: I've been thinking about 360 video for a while now and had an idea of doing green screen parallax with 360 mat plates. (er spheres in the case of 360) The idea came from watching Insta360 videos. (knowledge of their edit workflow is helpful to understand my theory...) My basic concept is that you would have three concentric video layers. The inner two would have transparent regions via chroma-key and the outer is the background mat. These would then be composited together for a two dimensional viewpoint (i.e. screen) with full parallax of the three spheres dependent on direction and "zoom".

IMPLEMENTATION: The first step would be rendering 360 video on a sphere and allowing navigation. (assuming basic PTZ) I figured that would be a good use-case for a sample. But you could easily go further and render multiple spheres with basic math to adjust the parallax. If you wanted to get even more wild you could add LUTs for color correction of each layer and connect it directly to mobile gyroscope and accelerometer to do something similar to the Insta360 app.

As I said above, I don't have time to work on this right now. But I thought this was worth doing and figured the Sokol community was probably the right place to share. I'd love to contribute to a bounty on this to see it developed. Just let me know where/how...