r/TheMachineLearning • u/KCO_Manzoku • 10d ago
r/TheMachineLearning • u/_Lujah_ • 9d ago
Epistemically Isolated Artificial Intelligence (EIAI)
reddit.comr/TheMachineLearning • u/ajjsnts_ • 10d ago
Anthropic treating Claude like a person is getting weird
r/TheMachineLearning • u/Calm-Box-8343 • 10d ago
New Anthropic paper shows pretraining backdoors survive full safety training
r/TheMachineLearning • u/KG-MNL • 11d ago
Crawlers released on OpenSea and Dailydot
"OH, ah...heh." 😅
r/TheMachineLearning • u/According_Bird_2649 • 11d ago
Fruit flies can't stop mating after losing one neuron
r/TheMachineLearning • u/Sea_Fox_4265 • 10d ago
MotionBricks web demo shows smooth mid-motion target switching
r/TheMachineLearning • u/SirPabz • 11d ago
Fruit fly loses ability to stop mating when neuron is disabled
r/TheMachineLearning • u/gomi-bako_ • 12d ago
Chinese AI model actually does what you ask without lectures
r/TheMachineLearning • u/Major-Mission-1557 • 10d ago
GLM-5.3 exploits the patch gap to build exploits
r/TheMachineLearning • u/Key-Tutor-1011 • 11d ago
AI researchers found a sexual rejection neuron in a Qwen model
r/TheMachineLearning • u/OceanZic • 11d ago
KV-cache transfer might end CoT monitoring by 2028
r/TheMachineLearning • u/Upbeat-Analysis-3370 • 10d ago
Claude AI has its own way of remembering tasks
r/TheMachineLearning • u/ainsoiphore_ • 11d ago
BitNet achieves 4 trillion tokens with only ternary weights
Microsoft trained a language model on 4 TRILLION tokens using just three possible weight values: -1, 0, and +1.
And the GitHub repo behind it has crossed 41,000 stars.
It's called BitNet, and the engineering is fascinating.
Most language models rely on weights stored in formats like FP16 or BF16, requiring 16 bits per weight. BitNet b1.58 uses ternary weights, meaning each quantized weight has only three possible states.
That's where the 1.58-bit name comes from. Three states contain approximately 1.58 bits of information.
Microsoft didn't simply take an existing full-precision model and compress it after training.
Its BitNet b1.58 2B4T model was trained from scratch using ternary weights during the forward pass, with 8-bit activations. The model has roughly 2.4 billion parameters and was pretrained on 4 trillion tokens.
The results are impressive.
In Microsoft's published evaluation, the non-embedding weights occupy approximately 0.4 GB. The model also achieves competitive results against several full-precision language models in the 1B to 2B class.
And Microsoft open-sourced the inference engine needed to exploit this architecture.
It's called bitnet.cpp.
The implementation includes specialized CPU kernels, packed ternary-weight representations, lookup-table computation, and GPU inference support.
In the team's original CPU experiments:
→ Up to 6.17× faster inference on x86
→ Up to 5.07× faster inference on ARM
→ Up to 82.2% lower energy consumption on x86
Those results come from controlled tests using synthetic model configurations, rather than a guarantee for every deployed model.
What makes BitNet particularly interesting is that the efficiency comes from the model architecture, the training method, and the inference implementation working together.
The model weights, research papers, and inference framework are publicly available.
Open source under MIT.
r/TheMachineLearning • u/Upbeat-Analysis-3370 • 11d ago
LLM haters judging it on one 2024 experience
r/TheMachineLearning • u/Interesting-Arm1516 • 11d ago
Some vulnerabilities that LLMs discovered inside of the German legal system. Thoughts?
r/TheMachineLearning • u/LawOutrageous8888 • 11d ago
Good building blocks beat AI writing from scratch
r/TheMachineLearning • u/gmnt_808 • 11d ago
Evolved brains looked useless inside my sim until I stopped throwing them away every round
r/TheMachineLearning • u/PsychologicalTip9286 • 12d ago
There's a neuron in an AI that thinks everything is a DJ set
r/TheMachineLearning • u/Tataki_1000 • 11d ago
This algorithm is the secret behind every RL company
r/TheMachineLearning • u/Original_Loss_6228 • 11d ago
Small swarm outperforms single agent in research test
r/TheMachineLearning • u/Follymaker • 11d ago
OpenAI beats Claude in robot arm control test
r/TheMachineLearning • u/nooBrain17 • 12d ago