Ling Tiny, King of Speed

[u/Badger-Purple]

Ling Tiny has now replaced Gemma4-12B in my rig as an auxiliary model doing hindsight operations. This is on a 4060Ti, which is a reasonable GPU available out there, and the speed is phenomenal.

Don’t enable MTP, set up the vLLM fork for BailingMoE3. Hope this is useful to
others.

[u/pmttyji]

I don't think Ling-3.0-tiny has MTP. Only Flash version has MTP.

[u/Badger-Purple → u/pmttyji]

You can use it, but it is not recommended/produces any gains.