SpatialGen decided to launch our internal streaming player for free. This player supports both regular spatial video and immersive 180/360 video. Download it for free today.

We launched the SpatialGen Streaming Player so the community could gather around a standard way to experience spatial video. We will be working on open-sourcing the project so everyone can leverage immersive video.

Apple is venturing into the realm of "Spatial Video" with its Apple Vision Pro, offering a unique twist on the familiar 3D experience. This approach relies on presenting different video versions to each eye, creating a subtle yet effective parallax effect for added depth.

A noteworthy aspect of this venture is Apple's adoption of the innovative MV-HEVC video format. SpatialGen recognizes the practical benefits of MV-HEVC, firmly believing in its lasting impact. Notably, MV-HEVC is designed for seamless backward compatibility with existing video players, allowing your spatial videos to effortlessly switch between 2D and 3D modes without disrupting established tools. Additionally, the structured nature of MV-HEVC facilitates more efficient compression, resulting in notably smaller video files compared to traditional 3D formats.

SpatialGen offers user-friendly tools tailored for MV-HEVC videos. Our online MV-HEVC encoder simplifies the conversion process, allowing you to transition your videos seamlessly. We also provide hosting for MV-HEVC streams, enabling direct content sharing with your audience. Leveraging advancements in artificial intelligence, our technology can enhance any video into a Spatial Video, adding a touch of depth to elevate your content library for a more immersive experience.

SpatialGen supports a variety of input formats, including videos with Dolby Atmos and ProRes footage.

Currently, we support all types of video ranging from homemade memories of family members to production-scale movies at 500 MB/s bitrates.

We have processed 180 & 360 stereoscopic videos from household brands, and we have converted entire 2D movies to 3D with HaloDepth at request of VFX editors. If we don't support what you're looking for, send us an email at contact@spatialgen.ai.

MV-HEVC stands for Multi-view High Efficiency Video Coding. This format is an extension of the popular HEVC video encoding format. By extending the format, MV-HEVC benefits from the efficient compression algorithms of HEVC and retains backward compatibility with existing video decoders. In this format, one eye of the spatial video is treated as the "primary view." The other eye will then be layered behind the primary view in the file.

This layering is what enables playback of these videos on regular devices. In a headset, where a screen is available for each eye, both layers will be shown to the viewer, creating the 3D and immersive effect of spatial video. On other devices, however, only the primary view needs to be displayed for the viewer.

This differs from traditional Stereoscopic formats where the two versions of the video are concatenated next to each other. This is an effective technique and has been the standard 3D video format for decades. The drawback of this format is that it makes playback more challenging. Extra work is required by the video player to split the video in half and display to each eye. Additionally, when watching a stereoscopic video, both eyes will be shown to a viewer regardless of the device they are watching on.

SpatialGen offers tools to convert video from Stereoscopic to MV-HEVC and back again. By supporting both video formats, you now have no restrictions on the devices that your spatial videos can be viewed on. MV-HEVC enables your videos to be viewed in the Apple Vision Pro and all existing video platforms. The stereoscopic format is needed to display your video on other popular headsets, such as the Meta Quest 3.

3D assets take up large amounts of memory. This can cause 3D game/app sizes to be gigantic. SpatialGen solves this by hosting developer's models on our high-speed CDN, and streaming them to the user.

1. Using Model3D's built in streaming service

let url = URL(string: "your-spatial-gen-url")!
let model = Model3D(url: url)

2. The second is using ModelEntity, which has more functionality but does not have a built in streaming service

We are providing the community with a script that will load a ModelEntity from our lightning fast network. Place this script in your project. We hope you like it :)

3. You can then load a ModelEntity from the network like so:

let spatialGen = SpatialGenHelper()
let url = URL(string: "your-spatial-gen-url")!
let modelEntity = try await spatialGen.loadEntity(from: url)

Apple Vision Pro also supports Spatial Photos. Similar to spatial video, each spatial photo consists of two versions in the file. When viewed inside the Vision Pro, one version is shown to the left eye, and the other version is shown to the right eye. The parallax created from differences in the versions is interpreted as depth.

Spatialy is a new iOS and VisionOS app that converts your existing photos into Spatial Photos. We are using the latest advancements in AI and image processing techniques to add an element of depth to your photo library.