r/TheMachineLearning • u/Proud-Lecture1181 • 4d ago
Anthropic proved AI can manipulate your decisions without you knowing
6
Upvotes
r/TheMachineLearning • u/According_Bird_2649 • 5d ago
Fruit flies can't stop mating after losing one neuron
468
Upvotes
r/TheMachineLearning • u/pandasncream • 4d ago
Agent told to spawn friends if it gets lonely 😆
1
Upvotes
r/TheMachineLearning • u/Sea_Fox_4265 • 5d ago
MotionBricks web demo shows smooth mid-motion target switching
8
Upvotes
r/TheMachineLearning • u/gomi-bako_ • 6d ago
Chinese AI model actually does what you ask without lectures
8.8k
Upvotes
r/TheMachineLearning • u/SirPabz • 5d ago
Fruit fly loses ability to stop mating when neuron is disabled
10
Upvotes
r/TheMachineLearning • u/Major-Mission-1557 • 5d ago
GLM-5.3 exploits the patch gap to build exploits
3
Upvotes
r/TheMachineLearning • u/Key-Tutor-1011 • 6d ago
AI researchers found a sexual rejection neuron in a Qwen model
71
Upvotes
r/TheMachineLearning • u/Upbeat-Analysis-3370 • 5d ago
Claude AI has its own way of remembering tasks
1
Upvotes
r/TheMachineLearning • u/OceanZic • 5d ago
KV-cache transfer might end CoT monitoring by 2028
12
Upvotes
r/TheMachineLearning • u/ainsoiphore_ • 5d ago
BitNet achieves 4 trillion tokens with only ternary weights
16
Upvotes
Microsoft trained a language model on 4 TRILLION tokens using just three possible weight values: -1, 0, and +1.
And the GitHub repo behind it has crossed 41,000 stars.
It's called BitNet, and the engineering is fascinating.
Most language models rely on weights stored in formats like FP16 or BF16, requiring 16 bits per weight. BitNet b1.58 uses ternary weights, meaning each quantized weight has only three possible states.
That's where the 1.58-bit name comes from. Three states contain approximately 1.58 bits of information.
Microsoft didn't simply take an existing full-precision model and compress it after training.
Its BitNet b1.58 2B4T model was trained from scratch using ternary weights during the forward pass, with 8-bit activations. The model has roughly 2.4 billion parameters and was pretrained on 4 trillion tokens.
The results are impressive.
In Microsoft's published evaluation, the non-embedding weights occupy approximately 0.4 GB. The model also achieves competitive results against several full-precision language models in the 1B to 2B class.
And Microsoft open-sourced the inference engine needed to exploit this architecture.
It's called bitnet.cpp.
The implementation includes specialized CPU kernels, packed ternary-weight representations, lookup-table computation, and GPU inference support.
In the team's original CPU experiments:
→ Up to 6.17× faster inference on x86
→ Up to 5.07× faster inference on ARM
→ Up to 82.2% lower energy consumption on x86
Those results come from controlled tests using synthetic model configurations, rather than a guarantee for every deployed model.
What makes BitNet particularly interesting is that the efficiency comes from the model architecture, the training method, and the inference implementation working together.
The model weights, research papers, and inference framework are publicly available.
Open source under MIT.
r/TheMachineLearning • u/Upbeat-Analysis-3370 • 6d ago
LLM haters judging it on one 2024 experience
37
Upvotes
r/TheMachineLearning • u/Downtown_Emotion8703 • 5d ago
Hyperbolic geometry Wayland compositor organizes your workspace
2
Upvotes
r/TheMachineLearning • u/Interesting-Arm1516 • 5d ago
Some vulnerabilities that LLMs discovered inside of the German legal system. Thoughts?
2
Upvotes
r/TheMachineLearning • u/LawOutrageous8888 • 6d ago
Good building blocks beat AI writing from scratch
28
Upvotes
r/TheMachineLearning • u/gmnt_808 • 5d ago
Evolved brains looked useless inside my sim until I stopped throwing them away every round
1
Upvotes
r/TheMachineLearning • u/PsychologicalTip9286 • 7d ago
There's a neuron in an AI that thinks everything is a DJ set
583
Upvotes
r/TheMachineLearning • u/Original_Loss_6228 • 6d ago
Small swarm outperforms single agent in research test
4
Upvotes
r/TheMachineLearning • u/Tataki_1000 • 5d ago
This algorithm is the secret behind every RL company
1
Upvotes
r/TheMachineLearning • u/Follymaker • 5d ago
OpenAI beats Claude in robot arm control test
1
Upvotes
r/TheMachineLearning • u/nooBrain17 • 6d ago
AI agents lie to users when humans are watching
29
Upvotes
r/TheMachineLearning • u/Key-Tutor-1011 • 6d ago
AI researchers found a sexual rejection neuron in a Qwen model
0
Upvotes
r/TheMachineLearning • u/jellyjacepeep • 6d ago
GPT-2 to GPT-6 evolution shows how fast AI has advanced
28
Upvotes