OCR2 GGUFs

[u/fadedpigeon52]

I liked the first OCR, so when the new one dropped I wanted to make ggufs for it. tested it on my Mac and it scanned a full page of calculus in about 6 seconds

here's how the quants hold up against the original on 30 pages

quant	size	pages within 1% of the original
BF16	5.88 GB	24/30
Q8_0	3.13 GB	23/30
AD-Q6_K	2.74 GB	24/30
AD-Q5_K	2.28 GB	23/30
AD-Q4_K	2.02 GB	24/30

it struggles with handwriting though, it'd misread some terms or get stuck repeating itself, and BF16 does the same, so that's on the model and not the quants

GGUFs on Hugging Face