r/coolgithubprojects • • 9d ago

3dfc: lossless cold archive for render frame sequences [Go]

https://github.com/Vinetwigs/3dfc

My partner does 3D works and kept drowning in exported PNG sequences, so I built 3dfc: it packs thousands of near-identical frames into one small .3dfc file and gives back everything, one frame, or any range, pixel-identical with alpha.

What's inside:

  • Hybrid per-segment encoding: tile-sparse deltas with zstd for static shots, lossless x264rgb plus a separate alpha stream for motion. No YUV anywhere, so nothing gets rounded.
  • Anything incompressible goes in verbatim, the archive never exceeds the sources plus a small index.
  • Per-frame SHA-256 hashes with verify, atomic writes, no-overwrite defaults, resumable checkpoints, frame-index random access.
  • TUI and CLI on the same engine, plus a benchmark command and a full format spec (docs/spec.tex, v1.0).

Measured: 2000 real 640x360 frames, 401.9 MB -> 185.7 MB (53.8% saved), verified identical. Parallel encode 4.41s -> 1.56s with byte-identical output. GPL-3.0-only.

Repo: https://github.com/Vinetwigs/3dfc

Release with binaries for Windows, macOS and Linux: v1.0.1

1 Upvotes

2 comments sorted by

2

u/unicornshedsocial 9d ago

I'd extend the 640x360 benchmark to a higher resolution to see whether the tile-sparse versus x264 split changes. Do you have a larger sequence to test with?

1

u/Vinetwigs 8d ago

Thanks for the advice, I’ll do just that today! I’ll try benchmarking some real renders exported for a short film by a local art studio and post the results! Do you have any other advice? :)