Rendering with ScanNet

[xz6014]

Hi there,

Hope that you could help.

I was trying to render a scannet scene with the COLOR SensorType, and I was getting the following error and warnings:

[16:14:25:206625]:[Warning]:[Metadata] SceneDatasetAttributes.cpp(107)::addNewSceneInstanceToDataset : Dataset : 'default' : Lighting Layout Attributes 'no_lights' specified in Scene Attributes but does not exist in dataset, so creating default.
[16:14:25:206832]:[Warning]:[Scene] SemanticScene.h(328)::checkFileExists : ::loadSemanticSceneDescriptor: File databases19/ScanNet/scans/scene0000_00/scene0000_00_vh_clean_2.scndoes not exist. Aborting load. ult.
[16:14:25:207037]:[Warning]:[Scene] SemanticScene.cpp(121)::loadSemanticSceneDescriptor : SSD File Naming Issue! Neither SemanticAttributes-provided name : databases19/ScanNet/scans/scene0000_00/scene0000_00_vh_clean_2.scn nor const ructed filename : databases19/ScanNet/scans/scene0000_00/info_semantic.json exist on disk.
[16:14:25:207088]:[Error]:[Scene] SemanticScene.cpp(137)::loadSemanticSceneDescriptor : SSD Load Failure! File with SemanticAttributes-provided name databases19/ScanNet/scans/scene0000_00/scene0000_00_vh_clean_2.scn exists but failed to load.
[16:14:25:364030]:[Warning]:[Sim] Simulator.cpp(594)::instanceStageForSceneAttributes : The active scene does not contain semantic annotations : activeSemanticSceneID_ = 0

Thanks in advance for your support!

[asuglia-alana]

Hello, any chance somebody can look into this? At the moment, we don't have a way to use Scannet in Habitat Sim.
We have the following files for a scene:

In [21]: ls
scene0015_00.aggregation.json  scene0015_00_2d-instance-filt.zip  scene0015_00_2d-label.zip               scene0015_00_vh_clean.ply                   scene0015_00_vh_clean_2.glb         scene0015_00_vh_clean_2.ply
scene0015_00.sens              scene0015_00_2d-instance.zip       scene0015_00_vh_clean.aggregation.json  scene0015_00_vh_clean.segs.json             scene0015_00_vh_clean_2.labels.glb
scene0015_00.txt               scene0015_00_2d-label-filt.zip     scene0015_00_vh_clean.glb               scene0015_00_vh_clean_2.0.010000.segs.json  scene0015_00_vh_clean_2.labels.ply

and we try to create a simulator in this way:

import habitat_sim
from copy import deepcopy
from habitat_sim.utils.settings import default_sim_settings, make_cfg

settings = deepcopy(default_sim_settings)
settings.update(
          {
              "max_frames": 1000,
              "scene": "scene0015_00_vh_clean.glb",
              "color_sensor": True,
          }
 )
cfg = make_cfg(settings)
sim = habitat_sim.Simulator(cfg)

This raises the following error:

Renderer: NVIDIA A10G/PCIe/SSE2 by NVIDIA Corporation
OpenGL version: 4.6.0 NVIDIA 535.54.03
Using optional features:
    GL_ARB_vertex_array_object
    GL_ARB_separate_shader_objects
    GL_ARB_robustness
    GL_ARB_texture_storage
    GL_ARB_texture_view
    GL_ARB_framebuffer_no_attachments
    GL_ARB_invalidate_subdata
    GL_ARB_texture_storage_multisample
    GL_ARB_multi_bind
    GL_ARB_direct_state_access
    GL_ARB_get_texture_sub_image
    GL_ARB_texture_filter_anisotropic
    GL_KHR_debug
    GL_KHR_parallel_shader_compile
    GL_NV_depth_buffer_float
Using driver workarounds:
    no-forward-compatible-core-context
    nv-egl-incorrect-gl11-function-pointers
    no-layout-qualifiers-on-old-glsl
    nv-zero-context-profile-mask
    nv-implementation-color-read-format-dsa-broken
    nv-cubemap-inconsistent-compressed-image-size
    nv-cubemap-broken-full-compressed-image-query
    nv-compressed-block-size-in-bits
[10:53:04:100772]:[Warning]:[Metadata] SceneDatasetAttributes.cpp(107)::addNewSceneInstanceToDataset : Dataset : 'default' : Lighting Layout Attributes 'no_lights' specified in Scene Attributes but does not exist in dataset, so creating default.
[10:53:04:100842]:[Warning]:[Scene] SemanticScene.h(328)::checkFileExists : ::loadSemanticSceneDescriptor: Filescene0015_00_vh_clean.scndoes not exist.  Aborting load.
[10:53:04:100863]:[Warning]:[Scene] SemanticScene.cpp(121)::loadSemanticSceneDescriptor : SSD File Naming Issue! Neither SemanticAttributes-provided name : `scene0015_00_vh_clean.scn` nor constructed filename : `info_semantic.json` exist on disk.
[10:53:04:100874]:[Error]:[Scene] SemanticScene.cpp(137)::loadSemanticSceneDescriptor : SSD Load Failure! File with SemanticAttributes-provided name `scene0015_00_vh_clean.scn` exists but failed to load.

Could you please help?

Thanks!
Cc'ing: @0mdc @dhruvbatra

[0mdc]

@aclegg3 , @jturner65 : Would you have some context on this?

[aclegg3]

Our scannet dataset use instructions can be found here: https://github.com/facebookresearch/habitat-sim/blob/main/DATASETS.md#scannet (not sure if things have changed since this was written).

From what I see here, I would suggest you check the "scene" path:
"scene": "scene0015_00_vh_clean.glb",
This should actually be the relative path to the asset (from the working directory) unless you have a scene_dataset_config.json referencing the directory or paths to the assets within.

See https://aihabitat.org/datasets/replica_cad/ for an example of setting up SceneDataset configs.