Brainstorm’s Do-It-Yourself TeleTransporter

Brainstorm has updated their Teletransporter live insertion graphic effect so clients can now do it themselves helped by The Foundry software and Adobe After Effects plug-in.

At Last year’s NAB, Brainstorm Multimedia drew enthusiastic crowds to see people and objects digitally inserted as if they had been physically transported into 3D virtual sets with the TeleTransporter feature their Virtual Studio application. This year at NAB, they are going to show you how you can do it yourself.

“The TeleTransporter feature within the Infinity Set capability of our Virtual Studio software application simulates the presence of a talent inside a remote video signal in real-time,” Ricardo Montesa, CEO of Brainstorm Multimedia told me when I interviewed him from his office in Madrid, Spain. “This makes it look like you are effectively ‘transporting’ the person from one location to another regardless of physical or temporal distance.”

Camera Tracker software using metadata to correlate camera position

Camera Tracker software using metadata to correlate camera position

That’s a pretty nifty trick by itself. But up to now, you had to send your video to Brainstorm for processing before the trick could be accomplished.

Now Brainstorm’s TrackFree technology can convert the presenting talent into an augmented reality 3D object, and the camera position shooting the inserted image is kept track of with the Tracking Exporter application in Adobe After Effects in conjunction with The Foundry’s CameraTracker plug-in.”

The inserted woman seems to really be on the field in 3D

The inserted woman seems to really be on the field in 3D

No matter how far distant the object is from the virtual set, the tracking software keeps each of their perspectives in sync.

“We use the Ncam from Ncam Technologies,” Montesa said, “and the object’s position from the Ncam and its movement is tracked as metadata in the Originating Location by a combination of After Effects and The Foundry’s plug-in software. This allows the presenter to be “transported” into the Destination Location by sharing the same camera perspective.”

Augmented Reality in the oval office

Augmented Reality in the oval office

"The result can be seen either as Augmented Reality where the inserted person or object is added to an existing scene,” Montesa continued, “or as Virtual Reality where the whole visual span from foreground to background is re-created in the system’s software. The more accurately the camera positions are tracked in both locations, the better the ‘TeleTransportation’ effect looks.”

Virtual reality--location unknown

Virtual reality--location unknown

This can be accomplished with either live shots or pre-recorded images as long as their camera positions are recorded with The Foundry’s CameraTracker.

“That means we can transport you either into a movie from the past, into a location happening in real time, or, if you store the source material, into a scene that will occur in the future,” Montesa said.

At the Originating Location, usually a green screen studio, the following components will be required:

  • 1 x Brainstorm Infinity Set Lite Track software license
  • 1 x HP Z840 workstation with an AJA Corvid 88 video card and a NVIDIA K6000 or M6000 graphics card
  • 1 x well-lit chroma (Green or blue screen)
  • 1 x HD/SDI camera with genlock
  • 1 x tracking system.
  • 1 x serial port data de-embedder

Both inputs, being the video and tracking data, are input into the Brainstorm workstation and are processed by Brainstorm’s Infinity Set software in order to determine the location of both the presenter and the camera within the virtual environment.

At the Destination Location you will need:

  • 1 x HD/SDI camera with genlock (Similar to the Originating Location camera)
  • 1 x tracking system.
  • 1 x serial port data embedder
Let us know what you think…

Log-in or Register for free to post comments…

You might also like...

AI – ML – DL – The Differences

Artificial Intelligence is more than just one element. In this article, we look at and describe the many parts AI encompasses.

Weather Channel Uses Immersive Mixed Reality to Educate Viewers About the Dangers From Winter Ice

In their latest hyper-realistic VR weather warning, The Weather Channel helps viewers better understand the potential dangers created by ice storms.

2018 NAB Show Highlights Complex State of the Industry

Following numerous private conversations and panel discussions at the recent 2018 NAB Show, it’s become clear that broadcasters are being challenged like never before to hold the line on CapEx spending while delivering more content across their linear platforms. Because o…

Articles You May Have Missed – August 16, 2017

Virtual Reality (VR). There are basically two camps; you love it or could not care less. The rabid VR fans look for every hit of a new product, technique or movie/clip to try. The reality is that creating VR…

EBU Weighs Up Costs, Challenges and Opportunities of Virtual Reality

The EBU (European Broadcasting Union) has urged the whole video service industry to unite behind Virtual Reality and avoid the mistakes made with previous attempts to deliver new experiences for users, such as 3D.