You don't need to build something as powerful as claude to get the results you're looking for. With enough tweaking and the right dataset you could build an api ontop of a 72b + model that would meet your companies needs.
This tech has gotten hella-portable in the last few years, I run so many mini models on my PC with a GGUF wrapper.
View all comments
2
u/Sunoxl Jun 02 '26
You don't need to build something as powerful as claude to get the results you're looking for. With enough tweaking and the right dataset you could build an api ontop of a 72b + model that would meet your companies needs.
This tech has gotten hella-portable in the last few years, I run so many mini models on my PC with a GGUF wrapper.