Scene reconstruction algorithms similar to autonomous vehicle smart ‘vision’
Autodesk unveiled more than 40 improvements to Flame intended to simplify the artist’s day-to-day and boost creative collaboration. Building on machine learning (ML) capabilities that address specific tasks in Flame, this update brings ML to Flame’s core toolset in the form of camera tracking technology.
The new camera tracker delivers automatic camera solves and 3D geometry output in minutes. Artists also gain a more robust finishing toolset for color grading through FX and editorial, in addition to Network Device Interface (NDI) video preview streaming for sharing work remotely with creative stakeholders around the world.
Using scene reconstruction algorithms similar to autonomous vehicle smart ‘vision’ and reality capture-type point cloud reconstruction, Flame’s new camera tracker ‘auto masks’ or ignores moveable objects like people, cars, bodies of water, and skies, and focuses the solve on the static scene environment only, so that artists no longer have to spend time manually masking out moving objects to get a reliable result.
In many cases, the new camera tracker provides artists with a one-click solve, delivering high-quality results with over 5,000 points in a fraction of the time it would take using traditional workflows.
A new look up table (LUT) loader lets users import an external file-based LUT or color transform from a wide variety of file formats (.3dl .cube .ctf .ccc) directly inside Action and Image toolsets, and apply the ‘look’ to the entire picture or part of it. Additional enhancements include broadened GMask Tracer functionality, expanded support for industry-standard tactile colorist control panels (Arc, Element, Wave 2, Ripple, Element-Vs), and Blackmagic RAW media compatibility.
Artists can now share full screen video remotely, either over a closed network or public internet, using any NewTek NDI receiver software or device for a virtual experience akin to an in-person, over-the-shoulder review session. The new feature is compatible with webcasting software like OBS Studio and streaming services like YouTube Live, Facebook Live, Periscope, and Twitch.
“2020 proved a year unlike any other for the media and entertainment industry, and although the pandemic introduced new challenges, we saw the creative finishing community come together to find new, innovative ways to continue working and deliver high quality content. Inspired by their resilience and adaptability, we’ve been listening to customers to evolve the Flame toolset so that it can help meet both current and future needs of artists,” shared Will Harris, Flame Product Manager, Autodesk. “The latest updates to Flame – including new ML-powered camera tracking, an integrated finishing toolset, and enhanced support for remote workflows – are a direct reflection of these efforts and feedback from the Flame community of artists.”
You might also like...
Ensuring consistency of lighting between the virtual world and physical objects on set requires controlling production lighting based on image content.
Virtual Production For Broadcast is a major 12 article exploration of the technology and techniques of LED wall based virtual production approached with broadcast studio applications in mind. Part 4 examines image based lighting, new developments in RGBW LED technology and what i…
One of the creative advantages of virtual production for performers is seeing the virtual environment in which they are performing. Using motion capture techniques extends this into capturing the motion of performers to drive CGI characters. New technologies are rapidly…
Sometimes, there’ll be a need to represent real-world objects in the virtual world. Simple objects could be built like any VFX asset; more complex ones might be better scanned as a 3D object, something some studios have begun to c…
Sending out a crew to capture a real-world environment can be a more straightforward option than creating a virtual world, but there are some quite specific considerations affecting how the material is shot and prepared for use.