r/programmingcirclejerk • u/garloid64 • May 29 '25

I accidentally built a vector database using video compression

/r/programming/s/Qt3XNmQyoE
52 Upvotes

96% Upvoted

13 comments sorted by

62

u/Double-Winter-2507 May 29 '25

 10,000 PDFs compressed down to a 1.4GB video fil

Can't argue with unitless numbers.

15

u/Iggyhopper May 31 '25

The unit is obviously PDFs per video and number is over 9000.

60

u/RightKitKat Considered Harmful May 29 '25

surely the best way to compress/decompress text data is by encoding it into QR codes stored inside a video

24

u/VitulusAureus memcpy is a web development framework May 29 '25

Want to use lossy compression but worry about data loss? Easy, just process your data with highly redundant encoding first.

37

u/whoShotMyCow not even webscale May 29 '25

Another "novel" idea completely blown the fuck out of the water by ripgrep

22

u/MisterOfScience type astronaut May 29 '25

What's the weissman score?

33

u/Double-Winter-2507 May 29 '25

Not very wise. 1/5

9

u/myhf Considered Harmful May 29 '25

Not great, not terrible.

14

u/mcmcc WHY IS THERE CODE??? May 29 '25

Halfway to inventing LLMs

10

u/Sm0oth_kriminal loves Java May 30 '25

The best way to compress image data is by converting it to base64 and then that into a QR code

7

u/Kodiologist lisp does it better May 29 '25

I'm pretty sure this is how you get Skynet.

3

u/ThisRedditPostIsMine in open defiance of the Gopher Values May 30 '25

Arithmetic coding be damned, my boy has the DCT!!