Skip to content

Align Orbbec EGO and SENSING camera schema and plugin architecture #1279

Closed

Description

@jiwenc-nv

Align the camera schema and plugin architecture between Orbbec EGO (#1252) and the SENSING stack (#1077 → #1078 → #998), so consumers can share camera contracts while vendor SDKs and transport details remain isolated.

PR descriptions establish the starting scope: Orbbec adds stereo video, IMU/audio, DeviceIO trackers, MCAP recording/replay, and synchronization tools. SENSING separates host setup, CUDA VMM IPC transport, and SIPL capture with H.264 or GPU-frame output. Code-level compatibility remains to be reviewed.

  • Run the five-persona comparison against recorded PR head SHAs; prioritize schema and plugin architecture.
  • Compare device/stream identity, frame sequence, timestamp units and clock domains, pixel format/layout, calibration, coordinate frames, and stereo association. Document shared fields and vendor-specific extensions.
  • Agree ownership boundaries for SDK capture, DeviceIO publication, buffer lifetime/synchronization, transport, encoding, recording/replay, and visualization.
  • Define the minimal shared camera contract and map both implementations to it; identify migration steps and dependencies without requiring identical transports.
  • Define validation: equivalent metadata from both producers, buffer ownership and reconnect behavior, timestamp interpretation, and recording/replay preservation. Separate hardware-required checks from SDK-free checks.

Status: panel review pending. The current workspace failed the review skill's branch-history checkout gate; no consensus findings have been produced.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions