Mo-Sys Reveals New LED Virtual Production Solutions

Mo-Sys Engineering reveals new solutions for LED virtual production with a high frame rate (HFR) StarTracker camera tracking system and the award-winning NearTime workflow extended to LED volumes.

NearTime for LED is a smart solution to solve multiple challenges when shooting in-camera visual effects (ICVFX) in an LED volume. At its most basic level it is an automated background re-rendering service for improving the quality and/or resolution of Unreal based virtual production scenes, and is used simultaneously alongside a real-time ICVFX shoot.

NearTime solves one of the key challenges of LED ICVFX shoots, which is balancing Unreal image quality whilst maintaining real-time frame rates. Currently every Unreal scene created for ICVFX has to be reduced in quality in order to guarantee real-time playback.

Using NearTime with an LED ‘green frustum’, the same Unreal scene can be automatically re-rendered with higher quality or resolution, and this version can replace the original background Unreal scene. Whilst it takes longer to do this, no traditional post-production costs or time have been used, plus moiré issues can be avoided completely!

Mo-Sys CEO Michael Geissler said, “We patented NearTime almost 8 years ago knowing that real-time graphics quality versus playback frame rate was always going to be an issue with ICVFX shoots. At that time we were focussing on green/blue screen use, but today LED volumes have exactly the same challenge.”

The company has also announced a special StarTracker for LED that provides camera and lens tracking up to 240fps for slo-mo shots, as would be typically used for fight scenes in high impact action films. In this scenario, rather than drive the LED wall at high frame rates to match the camera, which requires significant hardware processing and comes with an Unreal image quality impact, NearTime for LED is used to post-render the Unreal scene at HFR following the HFR ‘green frustum’ shoot of the talent performing. During the slo-mo shot review, the re-rendered Unreal background and the talent foreground are re-combined, delivering a significantly higher quality composited shot.

“Proxies were used as a smart solution to solving computer processing limits in the early days of digital compositing and colour grading,” Geissler commented. “Similarly, HFR StarTracker and NearTime for LED is a smart solution to shooting slo-mo shots in an LED volume.”

The HFR StarTracker for LED has been designed in anticipation of future GPU processing improvements enabling higher frame rate Unreal scene playback. In conjunction with Mo-Sys’ VP Pro XR content server, the HFR StarTracker’s programmable phase shift feature can utilise Brompton Technology’s Frame Remapping or Megapixel VR’s GhostFrame capability for simultaneous multi-camera shoots in an LED volume.

NearTime for LED will be available in Q4 to Mo-Sys customers with VP Pro and VP Pro XR. The HFR StarTracker for LED will be available early Q1 2022. 

You might also like...

Audio For Broadcast: Cloud Based Audio

With several industry leading audio vendors demonstrating milestone product releases based on new technology at the 2024 NAB Show, the evolution of cloud-based audio took a significant step forward. In light of these developments the article below replaces previously published content…

Why Live Music Broadcast Needs A Specialized Music Truck

We talk to the multi-award winning team at Music Mix Mobile about the unique cultural and creative demands of mixing music live for broadcast.

Future Technologies: Private 5G Vs Managed RF

We continue our series considering technologies of the near future and how they might transform how we think about broadcast, with whether building your own private 5G network could be an excellent replacement for managed RF.

An Introduction To Network Observability

The more complex and intricate IP networks and cloud infrastructures become, the greater the potential for unwelcome dynamics in the system, and the greater the need for rich, reliable, real-time data about performance and error rates.

Essential Guide: Location Sound Recording

This Essential Guide examines the delicate and diverse art of capturing audio on location, across a range of different types of film and television production. A group of seasoned professionals discuss their art and the how it can dramatically elevate…