Isotropix Forums

Referencing Alembic file keeps file locked

General Discussion about Isotropix and CG related topics

Referencing Alembic file keeps file locked

Unread postby atnreg » Sun Aug 30, 2020 11:59 am

Hi!

I have noticed weird and annoying feature in Clarisse and I would like to know if other people experience the same (a friend of mine confirmed it).

When I reference an Alembic file, Clarisse keeps the file reserved until I do first Resync Resources. Reload does not help, it must be the Resync.
This means that if I want to edit the Alembic outside of Clarisse (e.g. Blender or Houdini) while Clarisse is running and having that project open, I cannot update the Alembic until I have done the Resync Resources in Clarisse at least ONCE. The same happens when I open a Clarisse project that has Alembic file referenced.

This is very annoying. And what is even more weird is that in Clarisse 3.6 SP8b that did not happen but in the first 4.0 it started and still is in 4.0SP10.

The Alembic file contents does not have any effect on this, it may be one cube or complex scene, the result is the same.

Can anyone confirm this problem and possibly explain it and preferably suggest some fix for it? :)

Thank you very much!
Antti
AMD Ryzen Threadripper 2990wx (32c/64t),64GB RAM,NVIDIA GTX 1080ti,Win10
Clarisse 4.0(always latest SP),Houdini,Blender,Fusion360,Onyx,ZBrush...
Started: Clarisse 2016/10 (Py 2017/01), Python 2016/11
No business, just fun :)
atnreg
 
Posts: 550
Joined: Mon Sep 19, 2016 4:20 pm
Location: Helsinki, Finland

Re: Referencing Alembic file keeps file locked

Unread postby sam » Sun Aug 30, 2020 3:22 pm

Hi,

I'm surprised the behavior was different before 4.0. Maybe the update to the latest Alembic library explains it. Either way, while it's annoying on Windows (there isn't the problem on others platforms) this is perfectly normal. Clarisse must keep a handle to the file since it is streaming data on demand. If it didn't it would have to load the file all the time it needed to retrieve data from it.
Sam Assadian
Isotropix
CEO/Founder
User avatar
sam
 
Posts: 1561
Joined: Fri Jan 25, 2013 11:33 pm

Re: Referencing Alembic file keeps file locked

Unread postby atnreg » Sun Aug 30, 2020 3:46 pm

Ok, that may have big difference on large files, of course for small files there is no difference in speed.

Thank you for the explanation!

Hmm...but then why Resync unlocks it? It's good of course but I don't understand why, I would think the stream must be retained all time? :)
Last edited by atnreg on Sun Aug 30, 2020 3:49 pm, edited 1 time in total.
Antti
AMD Ryzen Threadripper 2990wx (32c/64t),64GB RAM,NVIDIA GTX 1080ti,Win10
Clarisse 4.0(always latest SP),Houdini,Blender,Fusion360,Onyx,ZBrush...
Started: Clarisse 2016/10 (Py 2017/01), Python 2016/11
No business, just fun :)
atnreg
 
Posts: 550
Joined: Mon Sep 19, 2016 4:20 pm
Location: Helsinki, Finland

Re: Referencing Alembic file keeps file locked

Unread postby sam » Sun Aug 30, 2020 3:49 pm

As I said, this problem is only on Windows because its ancient filesystem. If you put your files on a samba server for example, you won't notice the same problem since files will be stored on a linux filesystem.
Sam Assadian
Isotropix
CEO/Founder
User avatar
sam
 
Posts: 1561
Joined: Fri Jan 25, 2013 11:33 pm

Re: Referencing Alembic file keeps file locked

Unread postby atnreg » Sun Aug 30, 2020 3:50 pm

Ok, I still don't understand why Resync changes that but I'm glad it does :)

Thank you!
Antti
AMD Ryzen Threadripper 2990wx (32c/64t),64GB RAM,NVIDIA GTX 1080ti,Win10
Clarisse 4.0(always latest SP),Houdini,Blender,Fusion360,Onyx,ZBrush...
Started: Clarisse 2016/10 (Py 2017/01), Python 2016/11
No business, just fun :)
atnreg
 
Posts: 550
Joined: Mon Sep 19, 2016 4:20 pm
Location: Helsinki, Finland

Re: Referencing Alembic file keeps file locked

Unread postby tom_tm » Mon Aug 31, 2020 4:10 pm

I experienced also some problems since 4.0, when I have the files on a local drive, the file is locked, on network there is no problem.
I made a ticket one year ago:
https://www.isotropix.com/user/bugtracker/380

Greets Tom
tom_tm
 
Posts: 287
Joined: Mon Nov 18, 2013 8:20 pm
Location: Switzerland

Re: Referencing Alembic file keeps file locked

Unread postby atnreg » Mon Aug 31, 2020 4:33 pm

Ok and they have confirmed it is bug and added it to their database back then one year ago.

Maybe it would be time to fix it after one year? ;)
Antti
AMD Ryzen Threadripper 2990wx (32c/64t),64GB RAM,NVIDIA GTX 1080ti,Win10
Clarisse 4.0(always latest SP),Houdini,Blender,Fusion360,Onyx,ZBrush...
Started: Clarisse 2016/10 (Py 2017/01), Python 2016/11
No business, just fun :)
atnreg
 
Posts: 550
Joined: Mon Sep 19, 2016 4:20 pm
Location: Helsinki, Finland

Re: Referencing Alembic file keeps file locked

Unread postby sam » Mon Aug 31, 2020 4:59 pm

It is not a bug. The bug database is not up-to-date.
3.6 was buggy because the handle to the Alembic file must be kept opened in Clarisse since data is loaded on-demand during evaluation.
Sam Assadian
Isotropix
CEO/Founder
User avatar
sam
 
Posts: 1561
Joined: Fri Jan 25, 2013 11:33 pm

Re: Referencing Alembic file keeps file locked

Unread postby atnreg » Mon Aug 31, 2020 5:19 pm

Ok, you explained it a bit more in the ticket, thank you :)

But doing Resync closes the handle (confirmed using system tool to see reserved file handles) so why Resync can do that but simple open must not?
Does Resync do full load but open only reserves the handle?

Resync is kind of workaround but I would like to know what it may cause? It seems to have no effect on speed on small Alembics.
This is important because the idea of Clarisse having everything outside data as reference does not apply here and so we cannot update the Alembic and just then Reload it. We need to first to Resync and THEN do the updates and THEN do the Reload (or Resync).

And why other file formats work normally?
Is the reason that Alembic can be huge structure and so it cannot be read at once and so the handle must be kept open?
Antti
AMD Ryzen Threadripper 2990wx (32c/64t),64GB RAM,NVIDIA GTX 1080ti,Win10
Clarisse 4.0(always latest SP),Houdini,Blender,Fusion360,Onyx,ZBrush...
Started: Clarisse 2016/10 (Py 2017/01), Python 2016/11
No business, just fun :)
atnreg
 
Posts: 550
Joined: Mon Sep 19, 2016 4:20 pm
Location: Helsinki, Finland

Re: Referencing Alembic file keeps file locked

Unread postby sam » Mon Aug 31, 2020 5:47 pm

If Resync closes the handle (and doesn't open a new one) then it is a bug. If you can confirm, then post it as a bug. The handle should always be kept open.

Which other file formats are you referring to? If you are discussing about OBJs and LWOs then when they are loaded the entire file is loaded in memory (because we don't load them as a scene and at least there aren't efficient way to partially load OBJ data).
Sam Assadian
Isotropix
CEO/Founder
User avatar
sam
 
Posts: 1561
Joined: Fri Jan 25, 2013 11:33 pm

Next

Return to General Discussion