Facebook Transform. 360 video converter opensourced

The place to discuss development topics.
Discussions on the RICOH THETA API and SDK, image processing of spherical images, other hardware related topics, introduction of useful libraries, etc.

Facebook Transform. 360 video converter opensourced

Postby kosso » 22 Jan 2016, 00:59

So Facebook just open-sourced this : https://github.com/facebook/transform
It enables you to build a version of ffmpeg capable of transforming Equirectangular video into a cubic map projection (Gnomonic) video.

If you've ever inspected the videos on Facebook which are 360, you'll see they use this format. Also, I;ve found that when developing some Google Cardboard compatible apps for the Theta with three.js, etc., that projecting a 'cube map' (or 'skybox') provides a better effect than the Equirectangular image on a sphere.

fwiw: I really *really* wish that Ricoh would release something like this, so that developers can process the dual-fisheye video to Equirectangular, as the desktop app can do. (Do they read this? ;) )
kosso
 
Posts: 18
Joined: 10 Sep 2015, 12:16

Re: Facebook Transform. 360 video converter opensourced

Postby vishy » 29 Jan 2016, 11:13

Hi kosso,

very interesting.
When you say
as the desktop app can do.
which app are you referring to?
Also do you think that FFMPEG built with this filter would work on the .mov format given out by theta or should it run on the raw format?
And finally, were you able to build or find an exe of FFMPEG built with this filter?
vishy
 
Posts: 3
Joined: 07 Jan 2016, 09:21

Re: Facebook Transform. 360 video converter opensourced

Postby kosso » 01 Feb 2016, 21:34

Hi. I haven't had the time to try an build it yet, no.

Re: The desktop app: It contains (in the Air app bundle) another app call 'DualFishBlender' which converts the dual-fisheye video into Equirectangular video (same as the still images) whe you drag one on to it..

If (on a Mac) you use the Image Capture app to pull the video from the device over USB, you get the raw dual-fisheye version.


What's also interesting about the dual-fisheye is that when you connect via USB and activate 'live streaming' mode, then open a new Quicktime movie recording window, setting the camera input to the Theta, you'll see that the two fisheye on a live stream are rotated 90 degress compared to the ones that come pre-recorded off the camera. Weird.
kosso
 
Posts: 18
Joined: 10 Sep 2015, 12:16


Return to Development



All times are UTC