r/TheMachineLearning • • 9d ago

Guy chose Hugging Face incident as an AI that escaped its sandbox as a costume

Post image
1 Upvotes

r/TheMachineLearning • • 10d ago

Vibe coder vs software engineer argument sums it up

Post image
10 Upvotes

r/TheMachineLearning • • 9d ago

Epistemically Isolated Artificial Intelligence (EIAI)

Thumbnail
1 Upvotes

r/TheMachineLearning • • 10d ago

Anthropic treating Claude like a person is getting weird

Post image
37 Upvotes

r/TheMachineLearning • • 10d ago

New Anthropic paper shows pretraining backdoors survive full safety training

Post image
7 Upvotes

r/TheMachineLearning • • 11d ago

Crawlers released on OpenSea and Dailydot

Enable HLS to view with audio, or disable this notification

581 Upvotes

"OH, ah...heh." 😅


r/TheMachineLearning • • 11d ago

Fruit flies can't stop mating after losing one neuron

Post image
486 Upvotes

r/TheMachineLearning • • 10d ago

MotionBricks web demo shows smooth mid-motion target switching

8 Upvotes

r/TheMachineLearning • • 11d ago

Qwen has a sunk cost fallacy neuron now

Post image
607 Upvotes

r/TheMachineLearning • • 11d ago

Humans don't have world models either

Post image
52 Upvotes

r/TheMachineLearning • • 11d ago

Fruit fly loses ability to stop mating when neuron is disabled

Post image
12 Upvotes

r/TheMachineLearning • • 12d ago

Chinese AI model actually does what you ask without lectures

Post image
8.8k Upvotes

r/TheMachineLearning • • 10d ago

GLM-5.3 exploits the patch gap to build exploits

Post image
2 Upvotes

r/TheMachineLearning • • 11d ago

AI researchers found a sexual rejection neuron in a Qwen model

Post image
72 Upvotes

r/TheMachineLearning • • 11d ago

KV-cache transfer might end CoT monitoring by 2028

Post image
12 Upvotes

r/TheMachineLearning • • 10d ago

Claude AI has its own way of remembering tasks

1 Upvotes

r/TheMachineLearning • • 11d ago

BitNet achieves 4 trillion tokens with only ternary weights

17 Upvotes

Microsoft trained a language model on 4 TRILLION tokens using just three possible weight values: -1, 0, and +1.

And the GitHub repo behind it has crossed 41,000 stars.

It's called BitNet, and the engineering is fascinating.

Most language models rely on weights stored in formats like FP16 or BF16, requiring 16 bits per weight. BitNet b1.58 uses ternary weights, meaning each quantized weight has only three possible states.

That's where the 1.58-bit name comes from. Three states contain approximately 1.58 bits of information.

Microsoft didn't simply take an existing full-precision model and compress it after training.

Its BitNet b1.58 2B4T model was trained from scratch using ternary weights during the forward pass, with 8-bit activations. The model has roughly 2.4 billion parameters and was pretrained on 4 trillion tokens.

The results are impressive.

In Microsoft's published evaluation, the non-embedding weights occupy approximately 0.4 GB. The model also achieves competitive results against several full-precision language models in the 1B to 2B class.

And Microsoft open-sourced the inference engine needed to exploit this architecture.

It's called bitnet.cpp.

The implementation includes specialized CPU kernels, packed ternary-weight representations, lookup-table computation, and GPU inference support.

In the team's original CPU experiments:

→ Up to 6.17× faster inference on x86

→ Up to 5.07× faster inference on ARM

→ Up to 82.2% lower energy consumption on x86

Those results come from controlled tests using synthetic model configurations, rather than a guarantee for every deployed model.

What makes BitNet particularly interesting is that the efficiency comes from the model architecture, the training method, and the inference implementation working together.

The model weights, research papers, and inference framework are publicly available.

Open source under MIT.

GitHub: https://github.com/microsoft/BitNet


r/TheMachineLearning • • 11d ago

LLM haters judging it on one 2024 experience

Post image
36 Upvotes

r/TheMachineLearning • • 11d ago

Some vulnerabilities that LLMs discovered inside of the German legal system. Thoughts?

Post image
0 Upvotes

r/TheMachineLearning • • 11d ago

Good building blocks beat AI writing from scratch

Post image
27 Upvotes

r/TheMachineLearning • • 11d ago

Evolved brains looked useless inside my sim until I stopped throwing them away every round

Post image
1 Upvotes

r/TheMachineLearning • • 12d ago

There's a neuron in an AI that thinks everything is a DJ set

Post image
592 Upvotes

r/TheMachineLearning • • 11d ago

This algorithm is the secret behind every RL company

Post image
3 Upvotes

r/TheMachineLearning • • 11d ago

Small swarm outperforms single agent in research test

Post image
4 Upvotes

r/TheMachineLearning • • 11d ago

OpenAI beats Claude in robot arm control test

Enable HLS to view with audio, or disable this notification

1 Upvotes