Isotropix Forums

Light Field Baking

Light Field Baking

Unread postby xilofoton » Fri Aug 04, 2017 2:41 pm

Hi,

Recently GPU rendering and Octane came up in the forum ...

There is an upcoming feature In Octane, the light field/holographic baking:
https://youtu.be/n9oILsWlW1U?t=11m2s

Having a feature in Clarisse similar to this could be a huge advantage for DMP artists, I think.

The rendered result can be similar to deep image but all the samples which are visible from within the parallax boundary plane/box are rendered with all the possible BxDF results in this volume, as in the video. A holographic texture.

Artists can forget all the baking and DMP reprojection nightmares if enough resolution/quality is possible with this technique. There is the view dependent lighting information, so at the end the render is the uber deep image. Not just deep comp but camera anim change, proper parallax DOF and motion blur etc are possible. And because the samples are interpolated at the end, I guess this can be also a kind of noise reduction technique (spatio-temporal denoising).

I can imagine a workflow:
- Rough layout and rough lookdev
- The scene is baked into light field
- Camera anim is done with this baked volume(in different context or in other software) which can allow a real time raytrace based virtual cinematography.
- Compers start to comp with the rough but camera animated stuff
- 3D artist create the final layout, refine/add details as usual
- Rerender into HiFi light field
- Final comp
- Director/etc changes his/her mind and want different camera movement
- Artists can change it in comp or in 3D quickly and interactively if there is not too much difference

Actually Clarisse does this experience but starting with low resolution/quality and recomputing the whole scene with every change. For 3D DMPs, light field baking also can be good to bake the entire scene once and use it for all the shots, or create camera groups with similar positions, and bake one light field box for each.

The light field topic is huge, here is a great (and long) starting point:
https://www.youtube.com/playlist?list=P ... xlGmf3t9qW

A bit more compact, but also very good:
https://www.youtube.com/watch?v=4qXE4sA-hLQ

Cheers
VFX & Cinematic Scientific Visualization Artist, Clarisse Specialist
https://artstation.com/scivfx
https://scivfx.wordpress.com/
xilofoton
 
Posts: 240
Joined: Tue Jul 21, 2015 1:29 pm

Re: Light Field Baking

Unread postby xilofoton » Tue Oct 10, 2017 7:16 pm

VFX & Cinematic Scientific Visualization Artist, Clarisse Specialist
https://artstation.com/scivfx
https://scivfx.wordpress.com/
xilofoton
 
Posts: 240
Joined: Tue Jul 21, 2015 1:29 pm

Re: Light Field Baking

Unread postby dboude » Wed Oct 11, 2017 10:04 am

Hi Xilo,

Very Interesting. Do you know more about data weight light fields are producing?

Cheers
Démian
Isotropix
Technical Artist - Clarisse Specialist
User avatar
dboude
 
Posts: 1208
Joined: Mon Jul 03, 2017 10:51 am

Re: Light Field Baking

Unread postby xilofoton » Wed Oct 11, 2017 10:46 pm

Hi Démian,

not easy to answer, because I've heard 700GB/sec (!) for the Lytro Cinema camera as data throughput speed. On the other hand an Octane light field object can be compressed with 99+% efficiency. As I know these are few megabytes at the end, but are for web/VR. It highly depends on the volume size/resolution(angular too). For VFX it can be significantly bigger than a deep exr image, I guess, so it can be huge. However for DMP, one static volume should be enough in most cases.

These are light field photos with earlier Lytro cameras:
https://pictures.lytro.com/
VFX & Cinematic Scientific Visualization Artist, Clarisse Specialist
https://artstation.com/scivfx
https://scivfx.wordpress.com/
xilofoton
 
Posts: 240
Joined: Tue Jul 21, 2015 1:29 pm

Re: Light Field Baking

Unread postby dboude » Thu Oct 12, 2017 8:43 am

I definitely have to dig deeper into this techno'

Thanks
Démian
Isotropix
Technical Artist - Clarisse Specialist
User avatar
dboude
 
Posts: 1208
Joined: Mon Jul 03, 2017 10:51 am


Return to Feature Requests Archives