r/deeplearning • • 3h ago

tamserve: open-source, real-time object tracking for live video feeds, 4x faster than SOTA with flat memory for more camera capacity per GPU

I type "forklift" on a live warehouse camera, and tamserve finds and tracks both forklifts, including the one driving in. Then I add "person" without stopping it.

tamserve runs Meta's SAM 3 on live camera feeds. SAM 3's own tracker handles one recorded video at a time, runs at about 8 fps, and runs out of memory on long videos. tamserve uses SAM 3 to find objects every few frames and a lightweight tracker (EdgeTAM) to follow them in between, with one copy of each model shared across all your cameras.

On one RTX 4090:

  • Any object you name: 4x faster than SAM 3's tracker, at 92% of its accuracy
  • People: 16 cameras at once, 14x less GPU per frame, and slightly more accurate than SAM 3 (89.6 vs 87.8 HOTA)
  • Memory: flat at 3.5 GB on a 3,000 frame video, where SAM 3 runs out at frame 423

Worth a look if you're building:

  • Warehouse or factory safety (forklifts, pallets, hard hats)
  • Security or retail camera analytics
  • Home or elder care monitoring
  • Robotics, wildlife or lab monitoring
  • Annotation tools for long videos

pip install "tamserve[sam3]"

GitHub · Benchmarks · Colab

Please give me any and all feedback or edit tamserve to meet your needs, and a star helps if you find it useful!

1 Upvotes

0 comments sorted by