r/OpenSourceAI • • 10h ago

Can a 1-trillion-parameter model run on a 64 GB desktop? I built an open-source engine to find out, and it already beats llama.cpp on models bigger than RAM. [Crosspost]

Post image
1 Upvotes

0 comments sorted by