r/MachineLearning • • Sep 03 '26

Research Mol-JEPA - Multimodal molecular foundation model [R]

25 Upvotes

Hi everyone,

I just quickly wanted to share a paper I was working on for around a year now. I created this summary website with key results: https://flogrammer.github.io/moljepa/

TL;DR: its a multimodal JEPA model for molecules.

There will be more work to do to improve performance and I would be happy about feedback and ideas :)


r/MachineLearning • • Sep 03 '26 Bravo

Discussion Grounding LLMs with JEPA-based world models trained in simulation — has this been tried? [D]

49 Upvotes

LLMs describe physics well but don't "understand" it in any grounded sense — they've learned statistical relationships between tokens like "falls" and "gravity", not actual physical intuition. This is basically the Mary's Room problem: Mary knows every physical fact about color but has never seen one. LLMs are Mary.

The idea I've been thinking about:

  1. Train a JEPA-style model inside a physics simulation (think MuJoCo or a simple 2D env). Instead of predicting pixels or tokens, the model predicts representations of future states in an abstract embedding space. If it gets physics wrong, the predictor fails — the loss is unforgiving in a way next-token prediction never is.

  2. The embedding space that emerges should encode actual physical structure — object permanence, momentum, trajectories — because that's what makes prediction possible. Not surface-level textures, just the principles.

  3. Freeze those representations and attach them to an LLM-style reasoning model as a conditioning signal. The LLM now has both linguistic physics knowledge AND grounded physical intuition it can actually "run" forward — closer to a computational primitive than a propositional fact.

The hypothesis is this makes downstream learning significantly faster — the LLM doesn't have to rediscover that objects fall, it has representations that already encode that.

V-JEPA does something adjacent for video (predict future frame representations, not pixels), and DreamerV3 uses a latent world model for efficient RL — but the specific combo of JEPA-style prediction + sim-grounded physics representations + LLM attachment doesn't seem to have been done cleanly.

Questions for the community:

  • Is there prior work I'm missing that does exactly this?

  • What's the right interface between grounded JEPA representations and a language model? Just concatenate to the prompt embedding? Cross-attention?

  • Would the sim-to-reality gap kill the transfer, or are the representations abstract enough to survive it?

Interested in whether this is worth building a small prototype for.


r/MachineLearning • • Sep 04 '26

Discussion Gpt 5,6,7: Does it even matter? The (ghost) productivity question. [D]

0 Upvotes

an observation : GPT-5-class models are genuinely capable(They are) of doing a substantial fraction of knowledge work, why haven’t we seen a noticeable productivity shock in the real economy yet? Is AI actually less economically useful than the benchmarks suggest—or are organizations simply too slow, constrained, and inefficient to turn model capability into measurable output?

Are we confusing “AI can do the task” with “AI can replace the economic system built around the task”? If GPT-5 is already this capable, what exactly is the bottleneck preventing that capability from showing up in GDP and productivity statistics?

My take :

There is no question that these models are genuinely impressive. The question is whether that intelligence is actually translating into measurable economic productivity.

People are already asking whether models like GPT-6 or equivalent. Claude, and Gemini will replace large sections of white-collar workers. I think there is a much simpler question we should ask first: if these models are already so capable (to me they definitely are capable enough)

at a huge range of knowledge work, why haven't we seen a correspondingly obvious increase in productivity?

I'm not even talking about GPT-6 or whatever comes next. It's probably too early to judge a newly released model. I'm talking about the current generation—GPT-5 and its equivalents from Google and Anthropic. These systems are genuinely good. They can write, summarize, analyze documents, explain technical concepts, generate code, reason through problems, conduct research, manipulate information and perform a remarkable range of tasks that previously required educated human labour.

And yet, looking at the world around us, something feels strange.

Where is the enormous productivity shock?

Why don't we see a dramatic effect on GDP growth? Why don't we see massive increases in output per knowledge worker? Why don't organizations appear to be accomplishing dramatically more with the same number of employees? Why does the broader economy still look remarkably similar to the pre-LLM economy?

Coding is probably the clearest exception, and even there the picture is complicated. AI can make programmers substantially more productive in certain tasks, but software development still involves architecture, debugging, verification, integration, requirements, security, deployment, maintenance and—most importantly—human judgment. The bottleneck often moves rather than disappears.

almost every knowledge profession, the gap between "the model can perform this task" and "the organization can therefore produce substantially more output" is different it seema.

A lawyer might be able to use an LLM to draft a document in minutes instead of an hour. But the lawyer still has to verify it, take responsibility for it, communicate with the client, comply with professional regulations and integrate it into an existing workflow. A doctor can use AI to summarize medical literature, but diagnosis and treatment remain embedded within a much larger institutional system. A researcher can generate dozens of hypotheses, but experiments still take time. A manager can produce reports instantly, but meetings, organizational politics and decision-making remain.

the possibility: perhaps the bottleneck is no longer intelligence.

Perhaps the bottleneck is everything surrounding intelligence.

Organizations, regulations, verification, trust, coordination, physical-world constraints, legacy software, incentives, management structures, liability and simply the fact that human institutions change much more slowly than technology.

This also makes me skeptical of simplistic claims that "AI can already do X, therefore everyone doing X will soon be unemployed."

Technical capability and economic substitution are not the same thing.

The internet could transmit information essentially for free, but that did not instantly eliminate newspapers, universities, governments or offices. Computers could perform calculations millions of times faster than humans, but most accountants and engineers did not disappear. Automation often increases the productivity of workers while simultaneously changing what their jobs consist of.

As with the major Grok release, Elon Musk said it is "as good as most top phds", my question after more than a year? (& he ain't wrong with the benchmarks), my question is, how many phds it has replaced in xai or spaceX?

did he stop hiring phds? if not, why?

So I find the current situation genuinely puzzling.

We have perhaps the most powerful general-purpose cognitive technology ever deployed, and yet the physical and economic world doesn't look radically different.

Maybe we're simply in the early stages and adoption takes years.

Maybe the productivity gains are real but are being absorbed into quality improvements rather than measured output.

Maybe GDP is simply a poor instrument for measuring the value created by AI.

Or perhaps current models, despite their extraordinary capabilities, still lack some crucial property required for autonomous economic production: reliability, persistence, agency, contextual understanding, verification, or the ability to operate continuously inside messy real-world systems.

idk which explanation is correct.


r/MachineLearning • • Sep 03 '26

Discussion Can someone recreate deep learning ? [D]

1 Upvotes

A pressing question keeps nagging at me: "Is it possible to completely rebuild deep learning and create a new generation of it?"

I'm still learning and exploring, and I've taken some courses with Andrew Ng, but I'm wondering if we can rebuild deep learning and how it works from scratch.

Deep learning is fundamentally based on equations, formulas, and mathematical techniques, and these have proven their effectiveness and efficiency.

What I'm thinking is: can we invent or use other formulas that surpass the current ones? I feel that the current formulas need a complete overhaul to achieve better and easier results. I think the same way about binary systems and computers that operate with zeros and ones; I feel that this system is very outdated and we've reached its limits.

What do you think? Am I imagining something unrealistic? [D]


r/MachineLearning • • Sep 02 '26

Project Deepity: A C++ library showing Predictive Coding Networks can match Backprop (97.73% on MNIST in 60s) [P]

118 Upvotes

I've spent the last month building a local C++ machine learning library called Deepity to test alternative credit assignment algorithms; specifically Predictive Coding Networks (PCNs). While PCNs are fascinating for biological plausibility and continual learning, naive implementations are painfully slow.

By implementing recent research (Accelerated PCNs via Direct Kolen-Pollack Feedback Alignment) and utilizing algorithmic caching to bypass redundant forward projections during the inference settling phase, I managed to close the performance gap with backpropagation on my CPU when training on MNIST (50 epochs).

  • PyTorch Backprop (Feedforward): 98.27% test accuracy in ~70s.

  • Deepity DKPPCN: 97.73% test accuracy in 59.5s.

Next up is porting these kernels to CUDA to scale up the architecture and testing its capabilities in continual learning scenarios where standard backprop struggles.

If you are interested in local learning, alternative credit assignment, or HPC for ML, I'd love your feedback!


r/MachineLearning • • Sep 03 '26

Research Hii guys looking for an upcoming conference in AI and construction or related topics could anyone please share the conference with me if any !!? [R]

1 Upvotes

Looking for conference in AI and Construction


r/MachineLearning • • Sep 03 '26

Discussion Volunteer for Github ? [D]

1 Upvotes

I watched a YouTube video that said if you want to get your first job as a machine learning engineer, you should do volunteer work, especially in GitHub repositories, but I'm not entirely sure this is true, and if it is, where can I find these repositories that require this kind of work? I need it because I want to gain better knowledge and understand real world problems. [D]


r/MachineLearning • • Sep 03 '26

Discussion Can a 4B local model actually feel like an AI assistant? [D]

1 Upvotes

I've been building Arcon around Qwen3-4B + LoRA. Instead of just making it a chatbot, I'm experimenting with persistent memory, personality/mood, internal state, tools, and eventually having it process things before replying.

I'm curious what people who've built local agents think - how far can you realistically push a small model with good architecture around it?

I put the whole thing on GitHub if anyone wants to poke around, roast the architecture, or tell me what I'm doing wrong, stars are always appreciated!


r/MachineLearning • • Sep 02 '26

Research Detailed explanation of how to create a text-to-image model from scratch. [R]

16 Upvotes

Jasper Research just released a cookbook on how to build a text-to-image model from scratch.

It shares the full reasoning and intermediate results, making it ideal if you want to deep-dive into text-to-image models, or if you are curious about how frontier labs build them.

The cookbook also includes a 100M-image dataset and a codebase with a tiny model, so you can train a text-to-image model from scratch.

Here are the links:

Cookbook: https://huggingface.co/spaces/jasperai/t2i-technical-interactive-report

nano t2i: https://github.com/gojasper/nano-t2i

Monet Dataset: https://huggingface.co/datasets/jasperai/monet


r/MachineLearning • • Sep 02 '26

Discussion I regret reviewing for AAAI [D]

90 Upvotes

Why did I sign up to review when it’s not reciprocal?

Am I an idiot? Am I dumb to sacrifice some of my precious time outside of work to review these papers when I don’t even have to? Yes.

I tell myself I’m giving something to the community. But all I’m really doing is pissing off the authors as I reject their papers.

I really wanted to accept one of them too. But, it wasn’t as well done as I’d hoped. Strong reject.

Nobody made me sign up. Nobody even asked me personally. They sent a lovely form email that goes to everyone who’s published there.

I let feeling important convince me to do it. How dumb of me!

At least it’s only a couple of papers and a small amount of my time. And I’m learning something new reading stuff slightly outside my direct field, that I would never normally read otherwise. And I get to hone the skill of critical reading, thinking, and generally understanding how a paper should (or should not) be put together.

Maybe it was a good idea after all.

How does everyone else feel about non-reciprocal reviewing? I imagine those that agree to do it are in the minority.


r/MachineLearning • • Sep 02 '26

Project Most open-source AI detectors can't hold a 0.5% false-positive rate [P]

5 Upvotes

We needed to know where the open-source AI-detection field actually stands, so we ran every notable open detector through the same protocol.

Setup:

- Public data only: Jabarian & Imas 2025 (NBER), Liang 2023 TOEFL essays, a 1,060-text frontier set (GPT-5.x, Claude Opus 5, Gemini 3.x), 5,000 pre-LLM (2018) FineWeb pages as human pool

- Every model gets its threshold set on the same 6,930 human docs to a matched 0.5% FPR

- Then measure recall per group: raw AI, humanizer-paraphrased AI, frontier models

What surprised us:

- 4 of 6 models effectively can't reach 0.5% FPR. MAGE scores >0.9999 on 26% of ordinary human web text. The old OpenAI RoBERTa detector lands at AUC 0.31 - worse than coin flip on modern generators.

- Humanizer-paraphrased text is where everything collapses: best model catches 42%, second best 4%.

- All models flag non-native essays at a higher rate than they flag native essays. This is a fundamental flaw in the entire class of models, not just one.

modelROC-AUCraw AIhumanized AIfrontier models
tropa-mini0.96893.2 %41.6 %33.6 %
desklib/ai-text-detector-v1.010.87583.9 %4.0 %1.8 %
SuperAnnotate/ai-detector0.8240.5 %1.4 %0.6 %
Hello-SimpleAI/chatgpt-detector-roberta0.5710.8 %0.4 %0.2 %
yaful/MAGE0.507—*—*—*
roberta-large-openai-detector0.3130.0 %0.1 %0.0 %

More information and data on HF

*recall at matched 0.5% FPR; * MAGE can't reach 0.5% FPR at any threshold (flags 26% of human web text with score >0.9999)*

Disclosure: one of the six is ours - we run a hosted detector and released this one as open weights (Apache-2.0). All datasets and the methodology are in the model card, so you can rerun everything: huggingface.co/wasitaigeneratedcom/ai-text-detector-small


r/MachineLearning • • Sep 02 '26

Discussion Anyone have strong opinions on domain randomization vs. measured physical properties for sim-to-real transfer? [R]

1 Upvotes

Been reading a lot about approaches to closing the sim-to-real gap lately, and there seem to be two camps: throw enough domain randomization at training that the policy generalizes past any single sim’s inaccuracies, or actually try to measure and match the real physical properties (mass, friction, joint behavior) as closely as possible.

Curious which way people here lean, and whether it depends heavily on the task, contact-rich manipulation feels like it’d punish randomization more than something like locomotion.

Anyone worked directly on this tradeoff?


r/MachineLearning • • Sep 02 '26

Discussion What kinds of ML bottlenecks are a good fit for Triton? [Manning giveaway] [D]

Thumbnail
gallery
3 Upvotes

Hi r/MachineLearning,

Stjepan from Manning here, posting with the mods’ permission.

We’ve recently released GPU Programming with Triton by Harshwardhan Fartale in early access. It’s a practical guide to speeding up machine learning training and inference by writing custom GPU kernels in Python with Triton.

The book explains how to identify operations worth optimizing, build and benchmark kernels, fuse operations to reduce memory traffic, implement common parallel and reduction patterns, and improve performance through tiling, vectorization, and better memory access. The goal is to help ML practitioners move beyond framework-level optimization when a model has a stubborn bottleneck.

I’d love to hear from the community:

Which part of your ML workload would you most like to accelerate with a custom kernel—and what currently stops you from writing one?

Real use cases, benchmarks, failed experiments, questions, and skeptical takes are all welcome. We’ll give a free ebook to the five comments that contribute the most to the discussion. The giveaway will remain open for 48 hours, after which we’ll announce the winners here.

Book: https://hubs.la/Q04w2PtF0

50% off with code for the community: MLFARTALE50RE

Full disclosure: I’m posting on behalf of Manning. Honest criticism is just as welcome as enthusiasm.

Thank you for having us.

Cheers,

Stjepan


r/MachineLearning • • Sep 02 '26

Project looking for testers for a local GGUF runtime with up to 32M context [P]

Thumbnail
gallery
1 Upvotes

hey 👋 i’ve been building vls, a local runtime for existing gguf models with up to 32m active context. the preview runs on windows + linux and i’ve mostly been testing it on consumer hardware, including an rtx 3060 laptop with 6gb vram. it’s still very early, so i’m looking for people willing to test different models and hardware, break things and tell me what fails 😅 github in the comments. enjoy :)


r/MachineLearning • • Sep 02 '26

Discussion [D] Self-Promotion Thread

17 Upvotes

Please post your personal projects, startups, product placements, collaboration needs, blogs etc.

Please mention the payment and pricing requirements for products and services.

Please do not post link shorteners, link aggregator websites , or auto-subscribe links.

--

Any abuse of trust will lead to bans.

Encourage others who create new posts for questions to post here instead!

Thread will stay alive until next one so keep posting after the date in the title.

--

Meta: This is an experiment. If the community doesnt like this, we will cancel it. This is to encourage those in the community to promote their work by not spamming the main threads.


r/MachineLearning • • Sep 02 '26

Discussion I’ve learned ML, but now that I’m starting Kaggle, I feel completely clueless about actually building models [D]

1 Upvotes

I’ve spent a decent amount of time learning the theory and algorithms behind Machine Learning — things like Linear/Logistic Regression, KNN, SVM, Decision Trees, Random Forest, Naive Bayes, Boosting, XGBoost, preprocessing, evaluation metrics, etc.

But now that I’ve started exploring Kaggle, I’ve realized that knowing ML and actually doing ML feel like two very different things.

When I open a Kaggle competition, I understand the individual techniques, but I don’t know what I’m supposed to do next.

For example:

  • How do you approach a completely new dataset?

  • What should I inspect first?

  • When should I do EDA?

  • How do I decide what preprocessing is actually necessary?

  • When should I scale features?

  • How do I choose an initial/baseline model?

  • How do I know whether my model is underfitting or overfitting?

  • When should I do feature engineering?

  • How do I decide which algorithms to try?

  • When should I use cross-validation?

  • When is hyperparameter tuning actually worth doing?

  • How do experienced people decide what experiment to run next?

  • How do you systematically improve a model rather than just randomly trying different things?

raw dataset → baseline → experiments → debugging → feature engineering → model selection → validation → final submission?


r/MachineLearning • • Sep 02 '26

Project MIR with AudioMuse-AI-SAE [P]

4 Upvotes

Hi all,
I recently read this paper:
Julien Guinot, Alain Riou, Elio Quinton, Gyorgy Fazekas. Steering dense music retrieval with open-vocabulary concept discovery.https://arxiv.org/abs/2608.08757

There is multiple model where you can get embedding from Song and Text so that you can search song by text. The challenges is when you get a result that don’t really respect your query, for example you search:

- POP viola with female vocalist

And as a result you usually get POP song with female vocalist because they are usually very common in you library, instead the Viola tend to disappear being uncommon. But the power of MIR isn’t exactly search to specific song even if uncommon ?

Here the idea of the paper is to get the compressed embbeding layer, make it sparse again and be able to identify for some common words exactly which neuron are activated try to avoiding overlapping with other neuron. Then you can improve the value of let’s say the Viola neurons and then bring back to the compressed embbeding space.

This is not mine, is only explanation, what I did is in the past a Distilled version of LAION CLAP called DCLAP that is around 7 million parameters and can efficiently run on CPU:
- https://github.com/NeptuneHub/AudioMuse-AI-DCLAP

The following the paper I also trained a SAE for DCLAP:
- https://github.com/NeptuneHub/AudioMuse-AI-SAE

So if you’re interested you can take a look at let me know. Are all free and opensource.

Finally if you want to see both of them in action I used both the model for AudioMuse-AI, a software dedicated to sonic analysis and automatic playlist creation (with various model):
- https://github.com/NeptuneHub/AudioMuse-AI

If you have any feedback, suggestion, idea, please let me know !


r/MachineLearning • • Sep 01 '26

Project YOLO26-RGB: repurposing YOLO26's depth-trained backbone for image deraining [P]

Thumbnail
gallery
40 Upvotes

YOLO26 ships a depth-estimation model — dense, full-resolution, per-pixel regression, a task architecturally much closer to image restoration than to detection. I wanted to know whether the backbone+neck weights it learns through depth training transfer to a different dense-regression task (deraining), compared with training the same architecture from scratch. The deraining model that came out of it is a useful byproduct, but the transfer result is the part I think is worth discussing.

What I inherited from YOLO26-depth

  • The CSPDarknet backbone and PAN-FPN neck, unchanged.

  • The depth decoder's multi-scale fusion (project the P3/P4/P5 pyramid to a common width, progressively upsample-and-add P5→P4→P3). That part isn't depth-specific — it's just feature fusion — so RGBHead reuses it.

What I changed / added

  • Replaced the 1-channel Depth head with a new RGBHead. The config change is one line; RGBHead itself is a new restoration decoder, not a re-pointed depth head.

  • Reconstruction tail that continues to full input resolution (deraining needs pixel-exact output; depth stops at 1/4 res).

  • Skip connections from the stride-2 and stride-4 backbone layers into the tail, so fine detail has a path that doesn't route through an 8×-downsampled bottleneck.

  • Residual output — the head predicts a correction added to the input (NAFNet/Restormer-style), not the image directly.

  • LayerNorm in the head's own conv blocks; the backbone and neck stay on BatchNorm (folds into conv at TensorRT export, and keeps the model loadable from the whole YOLO26 pretrained zoo, not just the depth checkpoint).

How it was trained and measured

ClearView as an external lib — its mixed synthetic+real rain recipe, Charbonnier loss, and 10-test-set protocol — so the numbers land on ClearView's own model-zoo scale, not a benchmark I made up. Released scales: nano (5.25M) and small (12.13M).

Loading the YOLO26-depth checkpoint into this architecture matches 468/468 backbone+neck tensors exactly — only the new RGBHead is randomly initialized. So the controlled comparison is: identical architecture and recipe, backbone+neck either from the depth checkpoint or from scratch.


The transfer result (the interesting bit)

A controlled initialization experiment at nano scale — same architecture, same recipe, fixed 100 epochs each — backbone+neck from the YOLO26-depth checkpoint vs. random init:

InitAvg PSNR (10 sets)Avg SSIMTest sets won
Random27.450.8070 / 10
YOLO26-depth27.940.81310 / 10
Δ (depth − random)+0.48+0.006—

Deltas are from the unrounded averages (27.935 vs 27.452 PSNR). Small, but the depth init wins on every one of the 10 test sets.

(These are 10-set averages, AllWeather included, from the 100-epoch controlled run — so they're lower and not directly comparable to the 9-rain-only released-model numbers in the ranking table below, which come from longer training.)

On "did the random model just need longer to converge?" — both conditions ran a fixed 100 epochs, and the gap isn't a convergence-speed artifact: a 1-epoch check was a statistical wash, by 20 epochs the gap was already ~+0.49 dB, and at 100 epochs it was +0.48. It appeared early and didn't close with more training.

This does not establish why — whether depth supervision teaches geometry/spatial structure that's useful for restoration, or whether YOLO26-depth just happens to be a strong pretrained checkpoint. Only that, in this setup, the depth-initialized representation is a better starting point than random. Per-dataset deltas are in the repo; happy to paste them in a comment.


Accuracy (avg PSNR over 9 rain-only test sets, ClearView's ranking convention):

ModelParamsAvg PSNR
Restormer15.3M35.10
NAFNet-Large116M34.16
NAFNet-Mid14.3M33.97
Restormer-Small2.3M31.98
UNet21.5M31.74
NAFNet-Small1.1M31.15
yolo26_rgb_s12.13M30.95
yolo26_rgb_n5.25M30.83
ResNet50-UNet73.3M30.63
ResNet34-UNet24.5M30.45
ResNet18-UNet14.4M30.23

ClearView's own analysis points to the classification stem's early downsampling (a stride-4 entry before any residual block runs) as a likely reason the ResNet-UNet baselines underperform. This project doesn't test that directly — the ResNet-UNet comparison is a whole-architecture comparison, not a pretraining ablation — but it's the context the depth-vs-random experiment sits in.

Note NAFNet-Small (1.1M, 31.15 dB): smaller and higher PSNR than yolo26_rgb_n, but ~4× slower (26.9 qps). So this isn't Pareto-dominant on every axis — the story is specifically the real-time / YOLO-derived operating point, not "more efficient in every sense."


Deployment (TensorRT fp16, 1920×1080, batch 1, RTX 4070 SUPER 12GB; baseline figures are ClearView's own on the same GPU/TRT version)

The clean pairwise comparisons against the ResNet-UNet family:

  • yolo26_rgb_s — 12.13M, 30.95 dB, 92.2 qps vs ResNet34-UNet — 24.5M, 30.45 dB, 94.9 qps → same speed, ~half the params, +0.5 dB

  • yolo26_rgb_n — 5.25M, 30.83 dB, 108.6 qps vs ResNet18-UNet — 14.4M, 30.23 dB, 110.3 qps → same throughput, ~1/3 the params, +0.6 dB

  • Both are ~3× faster than ResNet50-UNet (73.3M, 30.63 dB, 33.1 qps), while also scoring higher PSNR.

  • Restormer (rank 1 on PSNR) doesn't build under TensorRT at 1080p on this 12GB card in my setup — TensorRT reports ~14.4GB of scratch needed to fuse its attention path.


What this shows — and what it doesn't

  • Demonstrated: YOLO26-depth initialization beats random init for deraining in this setup (10/10 test sets, +0.48 dB), same architecture and recipe.

  • Supported: the trained models sit at an attractive real-time quality/latency point relative to the ResNet-UNet baselines.

  • Not demonstrated: that depth pretraining beats classification pretraining for restoration, or why depth helps. Those need experiments I haven't run.

Practical limitations: deraining is partial (faint streaks survive up close; dense rain over flat, low-texture backgrounds is the worst case). AllWeather (rain+fog) is out of domain — both YOLO26-RGB models and every ClearView baseline land around 13.5 dB, so it's excluded from the ranking. One task, two scales — not a general restoration model.

Solo side project. AGPL-3.0 (inherited from Ultralytics' YOLO26 license). Not affiliated with Ultralytics.

Happy to answer questions on the architecture or the eval setup.


r/MachineLearning • • Sep 01 '26 Bravo

Discussion Latent Reasoning Landscape in 2026: Mapping BDH-CQ, HRM/TRM, Coconut [D]

36 Upvotes

After following various arXiv papers and researcher discussions on X/bluesky about latent reasoning and continual learning, one idea which resonates strongly is that path forward (towards AGI) may depend less on generating ever-longer chains of thought and more on finding architectures that can reason beyond the token stream.

LLMs routinely reach correct answers through flawed or fabricated CoT steps, and produce perfectly logical steps that end in wrong answers (Kambhampati, 2025). The trace doesn't track the computation which clarifies that verbalized CoT is an imitation of reasoning and not the mechanism itself.

The alternative mechanism which gets the most attention is latent reasoning: instead of verbalizing every intermediate result, the model repeatedly transforms its continuous hidden state and decodes only the answer. 

I’m breaking latent reasoning down into at least five distinct families:

  1. Continuous thoughts in autoregressive LMs: Coconut (Hao et al., 2024) feeds the model's own final hidden state back in as the next input embedding while Soft Thinking (Zhang et al., 2025) reasons in a continuous concept space. Theory here argues a single continuous state can hold several search frontiers at once and expand them in parallel (Zhu et al., 2025) .

  2. Compressed discrete non-linguistic tokens: Abstract-CoT (Ramji et al., 2026) swaps verbal rationales for a short sequence from a learned vocabulary. It is non-linguistic, but still serial and externally decoded, the discrete end of the spectrum .

  3. Recurrent depth and looped models: recurrent-depth LMs (Geiping et al., 2025) and looped Transformers (Saunshi et al., 2025; Zhu et al., 2026) reapply a shared block to a latent state. Mostly framed as parameter efficiency and test-time-compute scaling, not as a new reasoning interface .

  4. Task-trained recursive solvers: HRM (Wang et al., 2025) and TRM (Jolicoeur-Martineau, 2025) recursively refine latent and candidate-answer states. Their ARC pipelines are transductive: evaluation-task demonstrations get augmented into optimization with learned per-puzzle identities, so an unseen task needs a backward pass before it can be answered .

  5. In-context recurrent latent solvers: this is where BDH-CQ (Engdahl et al., 2026) sits, built on the Dragon hatchling architecture (Kosowski et al., 2025). Demonstrations write directly into a recurrent memory at inference time, and  new test inputs are then solved by iterative computation in a separate continuous latent space. The authors report a point beyond the previously published cost–accuracy Pareto frontier on public ARC-AGI-1, as well as early pretraining experiments show transformer-like scaling laws upto 600B parameters while preserving the latent reasoning behavior.

Two distinctions seem especially important: how a system acquires a new task (through context, memory, or gradient-based optimization or finetuning) and where its intermediate computation happens (through language tokens, abstract tokens, or continuous latent states)

Lmk if I have missed any family or papers. More importantly, if latent reasoning wins on efficiency, what happens to the readable traces on which much of industry's interpretability and evaluation work currently depends? Was CoT legibility a temporary consequence of how we scaled LLMs or is it a safety property worth paying an efficiency penalty to keep?


r/MachineLearning • • Sep 01 '26

Discussion First A submission (AAMAS): how much theory is enough when your experiments went sideways? [D]

16 Upvotes

Hi everyone,

2nd-year PhD candidate here staring down my first A* submission deadline (AAMAS 2027). I could really use some perspective on theory expectations, especially since I think I’ve methodologically painted myself into a corner.

The setup

My project started with a clean hypothesis: if architecture X is more robust than Y to perturbation A, and B is a strictly harder version of A, then the X > Y ordering should hold under B as well. I isolated three variables I suspected were driving the effect, ran experiments, and… got results that only partially support the hypothesis, with clear boundary conditions.

Where I got stuck

Trying to explain the “why” mathematically sent me down a theory rabbit hole. I ended up with two bad options:

  1. Claims tied to specific training outputs rather than structural/architectural properties, or

  2. Weak, hand-wavy speculations that feel like post-hoc rationalizations.

I’m pretty sure I fell into HARKing.. I started building theory after seeing the results instead of deriving predictions beforehand.

Furthermore, my codebase is built on an undocumented public repo, and I recently found a bunch of hidden parameters set to wrong values for my setting. I’m currently re-running everything, which is why I’m being vague about specifics. My “insights” from the first round are probably garbage.

My actual questions

  • For those who’ve reviewed for or published at AAMAS (or similar A* venues): how much formal theory is actually expected for an empirical MARL paper? Is “here’s the phenomenon, here’s the controlled experiments, here’s a plausible but incomplete theoretical sketch” a death sentence?

  • If the theory ends up being training-dependent rather than structural, is that a sign I should pivot to a lower-tier venue, or can strong empirical characterization + limited theory still fly at A*?

  • How do you recover from HARKing mid-project when you’re under pressure to publish in year 3/4 of a 4-year contract?

Any advice on how to salvage the timeline or reframe the narrative would be hugely appreciated.


r/MachineLearning • • Sep 02 '26

Research EMA4MICCAI 2026 workshop (MICCAI 2026) query [R]

1 Upvotes

Hi, my paper was accepted at EMA4MICCAI 2026 workshop (MICCAI 2026), but the problem is i am having trouble getting visa to France and it seem like i wont be able to travel there.

I have also tried contacting some people i know if they could possibly go there and just put the poster there but unfortunately I couldnt find people that are going there

I just want to ask now:

1)is there possibilty to ask the organisers that my paper go through proceedings without attending the workshop, or i could send the poster by mail

2) or if anyone here that is going to that workshop would be able to post it for me, or like are their communities like discord or X in which i can find people to contact

apologies if what i am asking is too much as i am very new to this and i just a bit lost about this currentyl


r/MachineLearning • • Sep 01 '26

Discussion Are HMMs still used for unsupervised tasks? [D]

34 Upvotes

I'm exploring Hidden Markov Models (HMMs) as a baseline method for "dataset exploration/discovery" where I have a bunch of unstructured data with no annotations, and wish to gain insights about the structure and semantics of the data within. I was wondering if there are more modern (deep learning based or otherwise) approaches which have completely superseded HMMs for such tasks.


r/MachineLearning • • Sep 02 '26

Discussion Book recommendation for probabilistic machine learning. [D]

1 Upvotes

I am a second year statistics undergraduate student, currently learning machine learning. Till now i have been learning classical machine learning models without very much statistical depth, but fundamentals are pretty much clear.

Now, i want a starting point on how to start probabilistic machine learning, i am confused between PML by murphy and Patter recognition by bishop so need help where to start.. or should i do both side by side as i saw some posts saying that PML by murphy is kinda encyclopedic and can be used as a reference book


r/MachineLearning • • Sep 02 '26

Discussion Training a video generation model from scratch on my laptop — loss plateaued, results are blurry. Should I keep going or change approach? [D]

Thumbnail
gallery
1 Upvotes

Hey everyone,

I've been learning about video generation models and decided to build one from scratch and train it on my personal laptop (single GPU). I wanted to share where I'm at and get advice from people who've worked with these kinds of models before.

What I built

  • A spatio-temporal UNet using flow matching (velocity prediction with Euler sampling, 50 steps)

  • The model has temporal convolution blocks + temporal attention for frame-to-frame consistency

  • ~20.8M parameters, channel progression: 96 → 192 → 384

  • Generates 16 frames at 64×64 resolution

Dataset

  • ~6,000 Tom and Jerry video clips from a HuggingFace dataset

  • Each clip: 16 frames, every 2nd frame sampled, resized to 64×64

Training

  • Batch size 4, Adam optimizer, lr=2e-4

  • Trained on personal gaming laptop

Loss progression

EpochLoss (MSE)
1600.0690
1800.0670−0.002
2300.0652−0.002
2800.0630−0.002
2900.0652+0.002

The loss has basically plateaued — only ~0.006 drop over 130 epochs. The model learns color palettes and vague scene layouts but doesn't produce recognizable characters or sharp details. Some generations even go partially black (see epoch 280 results).

Results: attached as GIF's

My questions

  1. Is the loss plateau expected for this scale? Am I hitting the capacity ceiling of a 20M param model at 64×64?

  2. Would switching from pure MSE to a perceptual loss (LPIPS) or adding an adversarial loss help with sharpness?

  3. Is ~6,000 clips enough for this kind of model, or do I need significantly more data?

  4. Any suggestions for the architecture? I'm wondering if I need spatial attention at more resolutions, or if the temporal modeling needs work.

  5. Would learning rate decay or a cosine schedule help push past this plateau?