Page 1 of 1

Light Field Baking

Unread postPosted: Fri Aug 04, 2017 2:41 pm
by xilofoton

Recently GPU rendering and Octane came up in the forum ...

There is an upcoming feature In Octane, the light field/holographic baking:

Having a feature in Clarisse similar to this could be a huge advantage for DMP artists, I think.

The rendered result can be similar to deep image but all the samples which are visible from within the parallax boundary plane/box are rendered with all the possible BxDF results in this volume, as in the video. A holographic texture.

Artists can forget all the baking and DMP reprojection nightmares if enough resolution/quality is possible with this technique. There is the view dependent lighting information, so at the end the render is the uber deep image. Not just deep comp but camera anim change, proper parallax DOF and motion blur etc are possible. And because the samples are interpolated at the end, I guess this can be also a kind of noise reduction technique (spatio-temporal denoising).

I can imagine a workflow:
- Rough layout and rough lookdev
- The scene is baked into light field
- Camera anim is done with this baked volume(in different context or in other software) which can allow a real time raytrace based virtual cinematography.
- Compers start to comp with the rough but camera animated stuff
- 3D artist create the final layout, refine/add details as usual
- Rerender into HiFi light field
- Final comp
- Director/etc changes his/her mind and want different camera movement
- Artists can change it in comp or in 3D quickly and interactively if there is not too much difference

Actually Clarisse does this experience but starting with low resolution/quality and recomputing the whole scene with every change. For 3D DMPs, light field baking also can be good to bake the entire scene once and use it for all the shots, or create camera groups with similar positions, and bake one light field box for each.

The light field topic is huge, here is a great (and long) starting point: ... xlGmf3t9qW

A bit more compact, but also very good:


Re: Light Field Baking

Unread postPosted: Tue Oct 10, 2017 7:16 pm
by xilofoton

Re: Light Field Baking

Unread postPosted: Wed Oct 11, 2017 10:04 am
by dboude
Hi Xilo,

Very Interesting. Do you know more about data weight light fields are producing?


Re: Light Field Baking

Unread postPosted: Wed Oct 11, 2017 10:46 pm
by xilofoton
Hi Démian,

not easy to answer, because I've heard 700GB/sec (!) for the Lytro Cinema camera as data throughput speed. On the other hand an Octane light field object can be compressed with 99+% efficiency. As I know these are few megabytes at the end, but are for web/VR. It highly depends on the volume size/resolution(angular too). For VFX it can be significantly bigger than a deep exr image, I guess, so it can be huge. However for DMP, one static volume should be enough in most cases.

These are light field photos with earlier Lytro cameras:

Re: Light Field Baking

Unread postPosted: Thu Oct 12, 2017 8:43 am
by dboude
I definitely have to dig deeper into this techno'