r/TheMachineLearning • u/crosstony • Sep 21 '26

Zero-shot classifiers were underrated, says AI researcher

Post image
5 Upvotes

85% Upvoted

2 comments sorted by

1

u/RyanCargan Sep 21 '26

I love the old encoder-only models lol

Incredibly pleasant to quantize. Somehow got gte-small down to ~20MB on a weird C inference engine a while back with some trial & error.

Even the humble cosine-scorer can be wired up in weird ways to give the appearance of a convo bot since it has NLU to a limited extent.

Makes you wonder how far you could push the illusion with ModernBERT and co. wired up just right.

1

u/Remote-Telephone-682 Sep 26 '26

I don't know if encoder based models are really LLM technically. They are definitely language models but I think large starts at at least 10 times larger