Figure 1: Oculus Rift—with headphones.
CES 2017 has come and gone with most press reporting Virtual Reality landed with a virtual thud. My view of CES is different because I see two very different types of VR.
The Star Trek “holodeck” version, the VR most of us are looking forward to, wasn’t present at CES. Rather, CES was a place to show off the first commercial versions of this type of VR. These products included the $600 Oculus Rift and the $800 HTC Vive. (Figures 1 and 2.)
Although both products received positive reviews—the Vive seems to me the better product. Both are expensive. And, they are only the beginning of the investment you may need to make. The Rift and Vive must be connected to a “VR” rated computer. The PC’s graphics board should be capable of outputting 2560x1440-pixels at a constant 90fps. This resolution is more than adequate for the current generation Vive that has a pair of 1080x1200-pixel OLED displays. (A total resolution of 2160x1200.)
Beyond owning a VR computer, Figure 3 shows the components that come with a Vive that you’ll use to setup your VR room. First, let’s look at the components you’ll be wearing or carrying. These are circled in green and are the items one typically thinks about: headset, ear-buds, and two hand controllers. Two rechargers (yellow) are provided for the controllers.
HTC provides a small box (blue), which connects to your computer (HDMI or Mini-DisplayPort and USB) into which you plug the 16-foot cable from the headset (power, USB, and HDMI). The HTC box has its own power-supply.
Looking around my living room, the items circled in red will cause the most setup difficulty. The two boxes are called Lighthouses and they sweep the “play area” with invisible light. The 37 dimples on the front of the Vive headset reflect the light back to sensors in the Lighthouses. Each Lighthouse has its own power-supply. (In some situations, the boxes must be connected by a “sync” cable.)
The setup “fun” begins when you learn where the Lightboxes must be located. As shown in Figure 4, they must be mounted on the wall using the included brackets. (Rift scanners are far easier to use because each sits on a table like a microphone on a stand.)
Adding to the setup complexity—the realization that walking around in an alternate reality is made both difficult and dangerous by the cable snake that leads back to your computer. The solution, demonstrated at CES, is a two-way wireless system. This link leads to a brief movie demonstrating TPCast's ~$250 wireless adapter for the Vive.
If you’ve been adding-up costs, even without a computer, the investment is almost $1000. At this cost, it seems relevant to ask, “What can you do with it?” Here’s a link to productions known to be coming in 2017. Of these productions, Fallout 4 and Essence look interesting.
Cheaper and Cheap VR
Figure 5 shows a stereoscope invented by Oliver Wendell Holmes in 1850. How did CES 2017 treat this type of VR I call “stereoscope VR?” Quite well. Stereoscope VR has many implementations and is already in wide use.
All VR cameras capture a 360-degree horizontal view, which means you can see everything around you. Most VR cameras also capture a 180-degree view from below to above the camera. The result is a spherical capture. The obvious way to capture a spherical image is by using six cameras. The cameras could be mounted on each face of a cube with each lens providing a 90-degree angle of view both horizontally and vertically. The issue is how can such a camera be held or mounted?
One sensible solution would be to eliminate the bottom camera. Were each side camera is able to capture a 120-degree image, when the four side images were stitched together a 60-degree “hole” would exist on the bottom image that would nicely prevent a tripod from appearing in the spherical capture.
Figure 6 shows a far more elaborate six-camera solution from GoPro that sells for $5000. During viewing, by one of several different means, you can view any area within the sphere. (A typical headset field-of-view will be about 100-110-degrees.)
The $3,595 Orah 4i is a slightly less expensive solution that uses four cameras to obtain a spherical 360-degree capture. (Figure 7.) Like the Omni, the Orah does not capture a 3D image. However, unlike the Omni, the Orah is able to output a live stream; for example from a drone.
The Samsung Gear 360 camera costs only $320. The Gear 360 has front and back cameras each of which captures a 180-degree view both horizontally and vertically. (Figure 8).
My hunch is that without 3D to create involvement, 360-degree VR will not have a long life. It also faces an obstacle we will look at later.
The cheapest solution appears to be the $800 Vuze from HumanEye Technologies. (Figure 9). The Vuze is equipped with eight FHD 30fps cameras capable of shooting 360-degree 3D footage. (The upward view is synthesized.)
Here is a link to 3D movies. Click on a 3D experience such as Old Jerusalem. Click the Eye to blue, set to 1080 or 1440, and expand to fullscreen. Lower your expectations and press Play.
At the opposite cost extreme, GoPro has announced the Odyssey with 16 cameras that captures 8K 30fps 3D video. (Figure 10).
I tend not to think of the recorded information from a 360-degree camera as an image. Instead, I think of it as a database of RGB values. When a particular “view” is required, sophisticated software employs the view’s coordinates to gather a set of RGB data and then generate pixels that represent the desired view.
The coordinates that define the current view can come from dragging a mouse left-to-right and as up-and-down on a computer display. When a smartphone is your viewing device, sensors built into the phone send data to the software. Data include the phone’s up/down tilt and the direction and acceleration of head turns. To prevent nausea, it’s necessary your view into a scene precisely moves as your head moves in 3D space.
There are three fundamental ways for you to view a 360-degree capture. A TV station in India enables the newsreader to control the view presented while presenting her story. This approach enables TV viewers to see a far more comprehensive picture of certain stories.
The most popular way to view these 360-degree images is to upload them to, for example, YouTube with metadata that signals that the upload should be presented in a viewer that enables one to drag a mouse around the screen to shift the view. And, here lies the source of the problem I mentioned earlier. When watching websites on a TV you do not have a way to drag the image to move the viewport. (Link to the YouTube VR site.)
The New York Times has a site with many VR stories. By downloading a VR app to your smartphone, you can browse their library and select an experience to view.
After selecting an experience from the Times website, quickly place your smartphone into your headset. Sounds simple, but I’ve found it’s not. First, the insertion can cause the power-button or audio-level buttons to be pressed. Second, smartphone’s are controlled by touching their screen—yet your phone’s screen is now deep inside the headset. When the few minute experience is over, to even repeat the experience, you’ll have to remove the phone to gain access to the screen. Way too frustrating!
The latest Samsung Gear 360 features a control-pad on its side. This is the solution to headset frustration. (Figure 11). Unfortunately, it only works with Samsung phones.
If you don’t care about 3D and want to spend ~$100, the Insta360 Air from Indiegogo might be a fun introduction to VR if you own an Android phone. (Figure 12). Follow this link to a marketing demo. (An IOS version is also available.)
Creating a sophisticated VR experience requires specialized software. GoPro, for example, provides three applications with their Omni package: GoPro Omni Importer, Autopano Video Pro, and Autopano Giga software. All run under Windows and OS X. Figure 13 is a screenshot of the Omni importer.
The VR experience, at least currently, is an isolated or isolation creating experience. This is the exact opposite of the experiences created by almost all other technology exhibited at CES. Most current technology empowers instant social communication. Even 3D TV could be enjoyed by a group of viewers. Does this difference suggest VR will attract a very different buyer? Or, will VR complement the time folks spend on social media?
How many hours will people spend walking around within a small confined area wearing a headset? How, when one is sitting on a couch, does one look backwards? Will VR equipment be bought only to be abandoned after playing only a few games?
Isolation and discomfort could lead to VR joining 3D TV in the junkyard of failed technology. And, unless VR grows rapidly, there will be less financial incentives to create “social VR media” such as Star Trek: Bridge Crew and perhaps more importantly, create narrative productions, e.g., Wilson’s Heart.
My guess is we won’t have answers to these questions until CES 2018, and perhaps not until CES 2019.
You might also like...
In their latest hyper-realistic VR weather warning, The Weather Channel helps viewers better understand the potential dangers created by ice storms.
Like many professional football players themselves, CBS Sports Lead television director Mike Arnold tries to treat the Super Bowl as he would a regular season game, calling the same shots and camera angles—albeit with many more cameras at his d…
The Intel True View allows a production team to recreate selected clips in 3D from any vantage point in a stadium or even from a player’s perspective.
This year’s Super Bowl LIII telecast on CBS will be produced and broadcast into millions of living rooms by employing the usual plethora of traditional live production equipment, along with a few wiz bang additions like 4K UHD and a…
Last Fall, “Orbital Redux” broke new ground for streaming entertainment as a live, scripted multi-episode sci-fi drama in which the audience determined the outcome of the action.