Repository navigation
sensing: send the camera video to the PC relay over a direct link - #1468
gareth-morgan-nv wants to merge 1 commit into
Conversation
The producer no longer publishes to LiveKit. Each stream's encoded H.264 units go over a direct TCP link to the PC relay (video_stage_worker), which publishes them. Streams are named (--add-stream=sensor=N,name=NAME,direct=HOST:PORT), and the LiveKit options become --fps, --scale-div and --bitrate. Each unit is matched to its capture by the stamp the encoder returns (the driver is asked to copy input timestamps), and a unit that matches none is sent without a capture time; --frame-correlation=fifo keeps the old by-order matching for previews. The encoder now writes a VUI so a receiving decoder does not hold back pictures. The timestamp basis is monotonic only, since that is the clock the link carries. This is a deployment change: an Orin on this build needs a running relay on the PC, and the LiveKit SDK is no longer fetched or installed for the producer. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com> Signed-off-by: Gareth Morgan <gmorgan@nvidia.com>
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the
|
|
✅ Preview deployed: https://NVIDIA.github.io/IsaacCapture/preview/pr-1468/ Built from commit 3e9aa42. It may take a minute for the updated preview to appear. |
|
Closing as superseded: the camera path is now the camera_streamer architecture (SIPL/Argus sender, AVS1 over TCP, PC receiver and LiveKit bridge; see #1473-#1479). Not merged; the branch and commits are kept. 🤖 Generated with Claude Code |
|
This PR is superseded by the camera_streamer PRs:
🤖 Generated with Claude Code |
Summary
The Sensing producer sends its camera video to the PC relay over a direct link instead of publishing to LiveKit.
Deployment change: an Orin on this build needs a running relay on the PC, and the LiveKit SDK is no longer fetched or installed for the producer. The stream option is
--add-stream=sensor=N,name=NAME,direct=HOST:PORT; the LiveKit options become--fps,--scale-divand--bitrate.--frame-correlation=fifokeeps by-order matching for previews, not for recording.Validation
Stacked on the relay PR.
🤖 Generated with Claude Code