Virtual production: the future of film

Technology has always been key for the art of filmmaking. It quite literally brings a script to life. And without it, cinema would not be possible. Most recently, virtual production has revolutionised the way films are shot and edited. Powerful game engines have now uncovered new possibilities, such as creating an entire set in the digital world.

virtual production :

What is virtual production?

Virtual production blends the physical and digital worlds of filmmaking. It involves working on a physical set while LED screens display real-time content, allowing the cast and crew to view and interact with virtual environments. Filmmakers can see their scenes unfold in the moment, rather than waiting for post-production.

It works by tracking the camera’s movement in a 3D space and encoding that information into a game engine, rendering the desired background environment to achieve parallax (virtual and physical exist in the same space). A large amount of the work is completed before the shoot, leading to a much shorter post-production process. Filmmakers can capture the ideal lighting conditions and recreate it again and again in the studio in a controlled environment.

How is it different from traditional filmmaking?

Traditionally, filmmakers would composite the environment onto a greenscreen using CGI in post-production. Instead, virtual production changes the entire method of filmmaking.

Pre-production

Beforehand, filmmakers would start with a greenscreen, building the environment off concept art later. Virtual production requires more groundwork. The environment must be fully imagined, approved and created before filming starts.

Production

A film set is known as an LED Volume: LED panels are set on the wall and ceilings to create realistic, immersive experiences. To begin, the environment needs to be up and running in the correct orientation and sizing. The camera also must be lined up on its mark. Any set pieces in the background should be placed to ensure it matches the background.

Virtual production sets do not require complicated lighting set-ups: lighting is managed through LED screens. While tracking cameras adjust the virtual scene and the cast and crew can make amends to lighting and angles in real-time.

continued...

Once a scene has finished, the cast and crew “turn around”. This means that the virtual environment moves to match the new orientation of the camera within the scene. Unlike traditional sets, the camera and lighting don’t need to be moved.

Alternatively, greenscreens only require a camera set up in front of it. This can be more challenging for actors as they have to imagine the environment they are supposed to be in.

Post-production

Having watched the scene unfold in the moment, the final part of the process should be streamlined. Using a greenscreen, editors would have to remove green from reflections and add an artificial reflection frame by frame. Virtual production should only require a few colour corrections and amends because the hard work is already done.

Virtual production benefits

-No time pressures, the perfect sunset exists all day long

-See it unfold through the lens and make real-time adjustments

-Realistic reflections and ambient lighting

-Create immersive experiences

-Shorter post-production time

Case study

Star trek: Discovery

In the most recent season, the series really did transcend worlds. It ditched greenscreens and adopted virtual production for the first time, kicking it off with a new custom-built set consisting of roughly 2,000 LED panels on the wall, 750 panels on the ceiling, more than 60 tracking cameras and Unreal Engine to synchronise it.

Back in 1888 when the first motion-picture film aired, we could never have imagined what filmmaking would look like today. Virtual production remains revolutionary despite its transition to the mainstream.

Virtual production