Inference on custom point clouds

[oscarlorente]

Hi, congratulations on your excellent work!
How can I test UnScene3D on my custom point clouds?
Thank you in advance!

[RozDavid]

Hey @oscarlorente,

Sadly, I don't have the bandwidth right now to create an interactive demo, maybe ina. couple months I will be able to get to it. In the meantime, you could modify this preprocessing script, loading a single/set of point clouds from your data.

The steps what you'd need to do:

• Mostly, you can follow this script for preprocesing your own meshes. Point clouds are a bit more tricky as we rely on the mesh manifold to initialize segments in our scene, but you could use a variant of HDBScan to extract point-based segments.
• If you don't have annotations for your clouds, just exclude those steps, and mask them with random 0-1 values as placholder foreground masks.
• You can drop the part as well regarding the axis alignment - that is also ScanNet specific only.
• Optionally if you need to also self-train on your own data, you will need to extract the pseudo masks with this script.

I hope that helps, and of course pull requests are very much welcome here :)

Cheers,
David