An Introduction to 360 & VR Video / Photography

Let’s get down to definitions. Lots of people are talking about 360° cameras, VR headsets, Google Cardboard, etc. I’ve heard the term “360° video” and “VR video” being used interchangeably on numerous occasions – and I’m here to tell you that they’re not synonymous. In this short article I’m going to introduce the main ideas and give you an overview of what everyone’s talking about. We’ll begin by briefly discussing some preliminaries (360° images and 360° video) before moving onto VR itself.

360° images:

These have been around for a long time and should be fairly self-explanatory. A 360° image is one that captures an entire scene in all directions. When just dealing with 360° horizontally these images are better known as panoramas as they tend to miss out the lower and upper portions of a scene, thus making them 360° (horizontal) x180° (vertical) images at best, but usually they’re 360° x 120° or even 360°x100°. For a true 360° image that’s 360°x360° you’re actually talking about “photospheres“. Even if you’re not familiar with the term, you’ve all seen them before. For example, when you switch to Google Street View and pan around on the spot in all directions – that’s a photosphere.
via GIPHY

360° video:

Just like 360°x360° images (or “photospheres” mentioned above) a 360° video is one that captures the entire field of vision (FoV) in all directions, both horizontally and vertically, giving you a full 360°x360° immersive video. In these videos you can pan around using your mouse or keyboard when viewing them on a desktop or laptop, or you can exploit the gyroscope sensor on your phone or tablet to pan around by simply moving the device itself (more on that in a moment).

VR:

The term “VR” (Virtual Reality) originally referred to an artificial reality that not only covered the viewer’s entire field of vision (FoV), but also enabled them to interact with that virtual world by moving around it. True VR achieves this whilst also appearing three-dimensional through what’s known as a stereoscopic projection. VR headsets accomplish this by splitting the screen in two. The headset lenses then focus and reshape the original two-dimensional view for each eye by angling two images to mimic how each of our eyes view the world slightly differently. Finally, the interactive element comes from using a gyroscopic sensor and accelerometer to track the users’ head movements and orientation and then render stereoscopic images to reflect these changing values in real time. Additional interactivity is then down to the software you’re using. For example, interactive VR games will allow you to walk or even fly around and your movements and actions in that virtual world can further alter the virtual environment you’re in.

Pseudo-VR:

However, a lot of videos viewed with VR headsets are not strictly speaking VR experiences – they’re merely 360° videos. There are two reasons for this: the first is that they’re not properly 3D as they weren’t recorded to create a true stereoscopic (i.e. three-dimensional) experience (more on this later). The second is that they’re not truly interactive: you can rotate on the spot, but you cannot move from that spot or interact with the virtual environment in any way. In short, you’re at the mercy of the videographer/director, passively observing from whatever fixed vantage point the camera rig was positioned. Now, I’m not saying that these sorts of 360° videos aren’t immersive or great to experience with a VR headset. I’m just pointing out that strictly speaking they’re immersive 360° videos, not VR videos. This is a rather important point as the confusion stems from how 360° videos are viewed. When played back on a desktop or laptop then they’re clearly just 360° videos and nothing more. But when viewed on a VR headset like Google Cardboard or the Samsung Gear VR, then people suddenly start referring to them as VR videos – but they’re not, for the same reasons mentioned above. For a 360° video to be a VR video it also needs to be stereoscopic (i.e. three-dimensional) at the very least. While VR headsets can simulate a stereoscopic projection by splitting the screen in two and trick your brain into seeing something in 3D, it can’t work miracles. So ultimately the three-dimensionality and DoF required for a fully immersive VR experience will always be limited by the quality of the original 360° footage (more on this in a moment). And that’s why the terms “360° video” and “VR video” are not always interchangeable.

Truly immersive VR:

At the risk of repeating myself, the point about a video being stereoscopic (3D) is extremely important here, as that’s determined by how the original video was shot. Currently every 360° video recording device on the market employs more than one lens and the recorded footage is stitched together using software to create a single 360° video. For example, the Ricoh pocket 360° cameras have two spherical lenses opposite each other, while more advanced 360° rigs employ an array of cameras (usually GoPro’s). If it was created by stitching together 2-6 different video cameras in different positions then it won’t be fully 3D when viewed on a VR headset because as the cameras in the rig aren’t close enough together you often lose that extra depth of field (DoF). That’s why the Google Jump rig uses sixteen GoPro’s in a circular array to minimize the warping effects of geometrical distortion, and in the process gives you a better DoF for a truly immersive VR experience.

The two different types of VR headsets:

Currently there are two options if you want to try out VR. You can either buy a complete headset that includes a built-in screen like the Occulus Rift. Or you can go for the more affordable route by buying a headset that uses your own mobile phone. For this you simply slot the phone into the headset and run apps on it that split the screen. Needless to say, this method is dependent on how good your phone is. The key requirements are a high resolution screen (minimum 1080p HD), a fast processor (quad core minimum) with lots of RAM (minimum 2GB) and a good gyroscope sensor and accelerometer to keep track of head movement and orientation. Ideally you’ll also need a phone with a good battery life, as you’ll find that many of the apps drain power like nothing else you’ve seen before!

 

Summary:

  • 360° photography: images are only truly 360° if they’re 360°x360° (horizontal and vertical), otherwise they’re just panoramas (i.e. 360° horizontally but miss out capturing a full 360° vertically).
  • 360° videos: these are created by stitching more than one video stream (with different cameras/lenses aimed at different angles from the same centre-point) together. For spherical lenses you need two separate video streams recording footage in opposite directions , but this tends to result in geometrical distortion and lacks the truly stereoscopic (i.e. 3D) feel which can only be achieved by using a lot more cameras/lenses closer together to give the video a better depth of field (DoF).
  • VR headsets: these are wearable headsets that cover your entire FoV (field of vision) and split the screen to create a stereoscopic projection that gives the viewer a 3D-like experience. By using gyroscope sensors and accelerometers they can track your head movement and orientation to adjust what you’re seeing in real time, thus making it feel as if you’re somewhere else.
  • True VR and mere 360° video experiences: the split screen stereoscopic trick employed by VR headsets will only ever be as good as the original footage you’re viewing. While video resolution is important, what’s equally neglected is how the original footage was recorded. More cameras in a rig results in less geometrical distortion and a greater DoF (depth of field), both of which massively enhance the authenticity of the virtual environment.

 

After reading this article you should now have a better overview of what everyone’s talking about and understand the differences between 360° video and VR itself, as well as the terminology used to evaluate them, like FoV, DoV, stereoscopic projection, and so on. By now you’re probably itching to try out shooting 360° video or get a VR headset. If so then check out our reviews section in which we test out all the latest devices!

Facebook Comments

Comments

comments

About Si 74 Articles
A keen Photographer, Runner and Cyclist.