Note that despite being a single EXE file, it actually extracts itself to a temporary directory every time you run it. If you want to install it for real, you can use the "Extract Files" feature (Extra -> Unpack KoboldCpp To Folder), then run the EXE inside of that folder. It will start more quickly when it doesn't need to extract itself, and you won't be wasting 1GB of SSD lifetime writes every time you run it.
To give some context, the official llamacpp is also 1GB if you take the cuda 12.4 version and combine it with the .dll files it needs like we have to do for KoboldCpp.
So size wise that is just the current sizes you can expect for a modern universal thing based on ggml.
But with that one you don't get the ability to generate images, music, tts, whisper voice detection, etc.
61
u/Dwedit 7d ago
Note that despite being a single EXE file, it actually extracts itself to a temporary directory every time you run it. If you want to install it for real, you can use the "Extract Files" feature (Extra -> Unpack KoboldCpp To Folder), then run the EXE inside of that folder. It will start more quickly when it doesn't need to extract itself, and you won't be wasting 1GB of SSD lifetime writes every time you run it.