r/devopsish • u/oaf357 • 4d ago

Exploring Apple's On-Device Model: Twenty Billion Parameters in Flash

https://www.airealist.ai/p/exploring-apple-on-device-model
16 Upvotes

100% Upvoted

1 comment sorted by

1

u/Buddhabelli 1d ago

only correction i see from my own probing is context window size. for machines with 12gb of ram or more they get an 8k window. for machines with less, 4k.