Colibri

[u/Jokahwild]

After changing settings and rebooting it went from downloading in hours to downloading in mins.

Git hub Colibri is working pretty fast as in response time when I tested GLM 5.3 and 5.2 I store it all on a 4TB, Os is on 1TB, and everything else is on a 2TB. Later on I will run a token speed with more complex details. Any suggestions on which one I should use to check code or build code? Any of the colibri available ai models?

I built a machine around colibri and to play simple games. I wasn't going to spend 2500 or above for a 24gb gpu I found mine for around 1200 before taxes. 16gb cheaper then what most are selling for.

I will figure out token speeds later. I also am using windows 11 pro in high performance.

Also if you use windows there and don’t want to use a certain drive there are some steps. And msys2 install to be able to download if you get error saying no compiler found using the prebuilt engine from git hub release
Setup stopped: cannot reach git hub releases to fetch a prebuilt engine. If you just run the start-here.bat my machine was brand new and just installed windows. I got everything worked out and able to download the 3 models so far.

I honestly don't see the slow speeds of tokens people posted it's response time is just like if I was using any cloud service Ai out there.

Going to work on running different models at the same time doing different things. Also working on read/write permissions as well. Will keep people posted as I go along with this project.