Embedded Files
Volumetric Video Production
Volumetric Video Production involves capturing multiple images of an object from various angles and using rendering techniques like photogrammetry to create the corresponding 3D model. Typically, the process requires mounting numerous cameras on rigid trussing and synchronising them with specialized equipment. These cameras are connected to a computer system via Ethernet or optical fibre cables, which process the image data at the desired video rate.
Limitations of existing systems
Existing volumetric video production solutions have several limitations. They are complex to set up, lack flexibility, and are costly to expand for larger scenes. Moreover, they cannot be used outdoors because they struggle to accurately reconstruct challenging environmental conditions like reflections, transparencies, and lighting variations.
In the extreme example shown here, the original photo of a crystal ball is compared with the reconstructed textured model that has been rendered using a conventional photogrammetry method.
Original photo of a crystal ball
3D textured model using photogrammetry
Towards a dynamic VVP system
To address these challenges, Nephelie developed a flexible volumetric video production solution that integrates a high-performance wireless network and a proprietary AI-driven video processing workflow based on Neural Radiance Fields (NeRFs) which produces superior 3D reconstructions as shown in the example of the crystal ball above.
The wireless network is specifically optimised for time-sensitive video applications, facilitating seamless camera synchronisation throughout the network while the utilisation of NeRFs not only generates realistic 3D renderings but also reduces the camera requirement, leading to further cost reductions.
3D model rendering using our nCOMM solution with NeRFs
The great outdoors
Unlike many existing solutions that rely on a fixed configuration of cameras and equipment, Nephelie's solution is wireless and lightweight, making it suitable for outdoor use and more versatile in different deployment scenarios. For example, in the scenario depicted below, Nephelie's wireless system is deployed outdoors to capture a large sporting event by attaching wireless cameras to a swarm of drones.
Page updated
Report abuse