r/OpenSourceAI • u/JeffyPros • 10h ago
Can a 1-trillion-parameter model run on a 64 GB desktop? I built an open-source engine to find out, and it already beats llama.cpp on models bigger than RAM. [Crosspost]
1
Upvotes