Skip to content

Semantics aren't loading correctly (Hm3D, Instance Image Nav) #2090

Description

@FlightVin

Habitat-Lab and Habitat-Sim versions

Habitat-Lab: master

Habitat-Sim: master

Master branch contains 'bleeding edge' code and should be used at your own risk.

Docs and Tutorials

Did you read the docs? https://aihabitat.org/docs/habitat-lab/ -> Yes

Did you check out the tutorials? https://aihabitat.org/tutorial/2020/ -> Yes

Perhaps your question is answered there. If not, carry on!

Semantics aren't loading correctly

For the sake of brevity, consider the following image showing the data present in the minival set of HM3D:
Pasted image 20241016200316 1

The relevant files that have been listed in README for semantics are present.

However, when I try to access the unique semantic labels here (permalink), I always get either 0 or 3. This is despite me setting the scene dataset correctly here.

I get the following warnings on InstanceImageNav-v1

[20:32:03:831051]:[Warning]:[Metadata] SceneDatasetAttributes.cpp(107)::addNewSceneInstanceToDataset 
: Dataset : 'hm3d_annotated_basis' : Lighting Layout Attributes 'no_lights' specified in Scene Attrib
utes but does not exist in dataset, so creating default.                                             
[20:32:03:831186]:[Warning]:[Scene] SemanticScene.h(328)::checkFileExists : ::loadSemanticSceneDescri
ptor: File/scratch/vineeth.bhat/sg_habitat/data/scene_datasets/hm3d_v0.2/minival/00802-wcojb4TFT35/wc
ojb4TFT35.basis.scndoes not exist.  Aborting load.                                                   
[20:32:03:831202]:[Warning]:[Scene] SemanticScene.cpp(121)::loadSemanticSceneDescriptor : SSD File Na
ming Issue! Neither SemanticAttributes-provided name : `/scratch/vineeth.bhat/sg_habitat/data/scene_d
atasets/hm3d_v0.2/minival/00802-wcojb4TFT35/wcojb4TFT35.basis.scn` nor constructed filename : `/scrat
ch/vineeth.bhat/sg_habitat/data/scene_datasets/hm3d_v0.2/minival/00802-wcojb4TFT35/info_semantic.json
` exist on disk.                                                                                     
[20:32:03:831210]:[Error]:[Scene] SemanticScene.cpp(137)::loadSemanticSceneDescriptor : SSD Load Fail
ure! File with SemanticAttributes-provided name `/scratch/vineeth.bhat/sg_habitat/data/scene_datasets
/hm3d_v0.2/minival/00802-wcojb4TFT35/wcojb4TFT35.basis.scn` exists but failed to load.               
[20:32:04:928962]:[Warning]:[Sim] Simulator.cpp(594)::instanceStageForSceneAttributes : The active sc
ene does not contain semantic annotations : activeSemanticSceneID_ = 0                               
2024-10-16 20:32:05,059 Initializing task InstanceImageNav-v1                                        

Any help would be appreciated. Thanks!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingsolution proposedA tested solution to the issue has been proposed in the comment thread.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions