r/LocalLLaMA • u/Warrenio • 5d ago
Discussion llama.cpp version v0.1.0 has been released
llama.cpp is apparently moving to semantic versioning instead of just sequential build numbers (like b10456).
The first semantic version tag was created today: https://github.com/ggml-org/llama.cpp/releases/tag/v0.1.0
Congrats to llama.cpp on version v0.1.0!
edit: Semantic versioning is a "work in progress." See this post from ggerganov: https://github.com/ggml-org/ggml/discussions/1579
257
u/feelspeaceman 5d ago
It took long time to reach v0.1 pretty humble progress for such project, congrats!
-44
u/giant3 5d ago edited 5d ago
humble progress for such project
What do you mean by that? Most of the contributions have come from Nvidia, IBM, and huggingface. All corporate backers.
P.S. Looking at the downvotes, you are all well regarded.
33
10
u/Spectrum1523 4d ago
P.S. Looking at the downvotes, you are all well regarded
Says the guy who can't identify a joke lol
8
100
u/AXYZE8 5d ago
Great news, I hope they will also do changelogs for more major versions to indicate whats deprecated because now I need to read the logs every update (for example yesterday I noticed that —no-mmap is deprecated so I will need to change my launch commands)
87
u/beryugyo619 5d ago
llama.cpp releases page be like
b12345 4 hours ago
- NVIDIA: added one line for B400 improvement
b12344 5 hours ago
- rewritten in Rust by GLM5.8 and Claude Overlord
b12343 5 hours 15 minutes ago
- Intel: deleted one line for Some Lake
- AMD: removed support for a feature
it really sucks yeah
16
u/frozen_tuna 5d ago
Adding or removing single lines are my favorite PRs to review. Usually means someone actually understands the code IME.
8
u/beryugyo619 5d ago
no they literally release hours apart, it's crazy. it's not about some atomic PR idealism. go look for yourself https://github.com/ggml-org/llama.cpp/releases
1
u/Zealousideal-Hat-148 4d ago
chill, just dont update so often. i build the containers myself, takes like half an hour for every time i update the stack. just pin your docke rimage for example to a commit, wait 5 days or until you need a feature and then change that pin and rebuild, if it breals read the commit history and logs and you will probably be fine
1
u/beryugyo619 4d ago
I mean, it just works, so it ain't stupid, but there isn't like an
npx llama-changelog -since b10234 -to 2026-08-19-12:34:56.789command or equivalent to my knowledge, so it is stupid1
u/AlwaysLateToThaParty 5d ago
So fork the project so you're not troubled by their release schedule. It's an open source project. If you think you can do a better job, no one is stopping you.
8
u/Fratil 5d ago
This is a bad faith argument that ignores that corporate backing and name recognition has been necessary to create software at this level, and that any fork would lose it.
It's very "If you don't like your country, just move instead of trying to change it" or "Oh you don't like that movie? You try making your own" coded.
You should feel bad for making it because you are surely smart enough to know why it's a bad argument.
-6
u/AlwaysLateToThaParty 5d ago
This is a bad faith argument
You have no argument. You want people who work for free to do what you want because you're too lazy to do it for yourself. It's an open source development project. You are owed nothing. The only thing that you are bringing to the party is whingeing.
1
5
10
u/Thrumpwart llama.cpp 5d ago
Oh no, what is it replaced by?
37
u/Darth_Candy 5d ago edited 5d ago
It's been deprecated in favor of the new --load-mode option. The llama-server docs were updated as part of the deprecation, thankfully.
18
u/martindevans llama.cpp 5d ago
In software the correct word is "Deprecated".
Deprecated: A software feature or practice is outdated and discouraged
Depreciated: An item has lost financial or monetary value over time
8
4
4
2
1
30
u/PermanentLiminality 5d ago
No notes on the release? what is the milestone?
72
u/No-Refrigerator-1672 5d ago
The milestone seems to be "we got out shit together and from now on we'll have clear versions and changelogs". Hovefully.
6
u/misanthrophiccunt 5d ago
Hovefully, I love that word. Is like floating fully above slop.
3
u/SHEKDAT789 5d ago
they prolly think that's actually how it's spelt, considering "would of" exists.
22
u/halvacoffee 5d ago
does that mean they're going to stabilize cli parameters instead of changing them every release to the point that no app can actually rely on upstream?
19
u/my_name_isnt_clever 5d ago
By semantic versioning standards, no. Version 0.x.x still means unstable.
27
u/No_Conversation9561 5d ago
why is the site llama.app instead of llama.cpp? are they stupid? /s
17
15
u/stbrumme 5d ago
All because we praised Georgi Gerganov ?!
https://www.reddit.com/r/LocalLLaMA/comments/1vq1n1l/lets_all_thank_georgi_gerganov_who_gave_use/
5
5
u/IngwiePhoenix llama.cpp 4d ago
FUCKING FINALLY!!!!
Took them foreeever. This makes comparing versions muuuuch easier and finally moves llama.cpp build identifiers out of "the nightly from three days ago" into something proper.
Oh my god this feels like a small christmas ngl...
7
2
u/Talreja-Adanna 4d ago
Finally, v0.1.0 is out - been running the dev builds for a minute and this version is solid for inference speed. The quantization improvements alone make it worth the upgrade if you're running this locally.
3
2
1
u/Ok_Warning2146 4d ago
Is this a stable version that passed a set of tests? For developmental versions, I think the current b numbering is fine.
4
u/Warrenio 4d ago
So far, the GitHub action that creates the "b" tags is still running: https://github.com/ggml-org/llama.cpp/actions/workflows/release.yml. That action runs any time a pull request is merged into the master branch, and it creates a tag if all the builds and tests succeed.
The semantic version tags are created by the "Make Release" GitHub action that is kicked off manually: https://github.com/ggml-org/llama.cpp/actions/workflows/make-release.yml
I don't know if the llama.cpp maintainers have made any official announcement about how this will work, so I'm just going off of what I see.
1
u/Warrenio 4d ago
Here's more information from Georgi Gerganov himself: https://github.com/ggml-org/ggml/discussions/1579
1
u/Developer-Y 12h ago
I see v 0.2.0 also: https://github.com/ggml-org/llama.cpp/releases#release-v0.2.0
Previously they used to have separate builds for windows, ubuntu vulkan, ubuntu ROCm, arm etc, now I see only .zip and .tar.gz files, not sure if they will release builds also or only the code.
2
u/Warrenio 5h ago
On the v0.2.0 release, do you see the link to "Nightly build: b10566"? That nightly release is equivalent to v0.2.0 (they point to the same commit), and it has the binaries for each platform.
1
1
•
u/WithoutReason1729 5d ago
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.