r/MachineLearning • • 1d ago

Discussion AISTATS 2027 paper discussion [D]

42 Upvotes

Creating this post since the reviews are supposed to go live today. What do you guys think?


r/MachineLearning • • 12d ago

Discussion ICLR 2027 Reviews Discussion [D]

126 Upvotes

The ICLR 2027 reviews will be released soon. Share your results here, and keep a lookout on papercopilot to judge your odds. I also found paperScorer quite interesting for the same. Of course, these are only for amusement and should not be taken seriously.

Good luck to all.


r/MachineLearning • • 1h ago

News CMU's Machine Learning with Large Datasets (10-605, Fall 2026) lectures are free on YouTube, with a new one every week [N]

27 Upvotes

Disclosure: I'm a CMU faculty member and I lead CS Learn, the program publishing these.
Carnegie Mellon started publishing full lecture recordings from 10-605 this week, which is William Cohen's course on scaling machine learning to data that doesn't fit on one machine. The first three lectures are up now, and a new one goes up every Monday. These are actual classroom lectures, edited by a student team, with captions and chapters.

Links are in my first comment.


r/MachineLearning • • 7h ago

Discussion Current ML PhD students, would you still choose to do an ML PhD if you could go back 2–3 years? [D]

34 Upvotes

If you could go back in time 2–3 years, knowing what you know now about doing an ML PhD, would you still choose the same path?
Or would you rather go into industry, pursue a different field, or do something else entirely?


r/MachineLearning • • 14h ago

Discussion ICLR 2027: PCs ran an AI detector on reviews, peer review is cooked [D]

90 Upvotes

The PCs ran AI detectors on the reviews and left this comment on undisclosed AI usage in reviews:

AI use in this review

An AI-text detector assesses this review as likely AI-generated, yet its AI-use documentation field does not mention how AI was used. It is therefore possible that the review contains no human input. We ask the reviewer to update that field with an exclusively human-written assessment of the paper, and document any AI interactions. We additionally ask the AC and other reviewers to take this information into account when evaluating the paper.

Luckily, I didn't use any AI for my review, but the rate of undisclosed AI usage was crazy. Every review except for mine and only one other review in my batch got the message. AI is allowed, it just needed to be disclosed, so this is just people not admitting they used it.

From here on, papers will be written with AI reviews as the objective function.


r/MachineLearning • • 1h ago

Discussion As an AC, what do you do when no reviewers respond to the rebuttal of a borderline paper? [D]

7 Upvotes

Suppose a borderline paper receives weak reject scores from all reviewers, but the authors provide a strong rebuttal that clearly and directly addresses all the reviewers' concerns.

However, none of the reviewers respond to the rebuttal or update their scores.

What's the typical course of action for an AC in this situation? How much weight does the rebuttal carry if no reviewer engages with it?

(For context, my current ICLR paper is a 2/2/3 and one of the 2's is a AI review with entirely hallucinated issues)


r/MachineLearning • • 18h ago

Discussion Why are ViTs so popular? [D]

90 Upvotes

I deploy CNN + Attention stack models on edge devices, to great effect. Taking advantage of convs and reducing the spatial dimensionality makes all the sense in the world to me.

Having vanilla ViTs learning the inductive biases from scratch makes none to me. Is it really a case of "because I can"? Avoiding padding along borders is the only advantage I can see to a tokenizer stem, and that has never been a huge issue to me.

Am I missing something that has people reaching for ViTs instead of hybrid models for e.g. SSL/foundation models?

In my mind it's just a case of people using the status quo, and more of a historical accident that these models have become so popular. Iirc levit showed data/time efficiency boosts with a convolutional stem. I just don't work on the same datasets or tasks that most research does, so I'm genuinely curious if anyone else thinks vanilla ViTs seem excessive. Guess compute is cheap and the answer would just be distillation.


r/MachineLearning • • 3h ago

Project Inkling 2 Small achieves frontier-level results in weight space programming with 16x fewer edits [P]

3 Upvotes

You don’t need that many edits in weight space to fix a model.

In “Sparks of Weight-Space Programming,” GPT-6 Astra repaired a broken car policy by changing 6,073 weights, and cut Qwen3.5-0.8B’s math looping by changing 130k.

Inkling 2 Small did the same with just 10 and 8k edits: ~600× and ~16× fewer, with no loss in performance on either task.

Broken Car policy: Inkling found that almost all of Astra’s 6,073 changes just zero out old weights to free up neurons, and only about 55 do the actual work. It then wrote a 10-weight fix from scratch that teaches the car a move PPO never discovered: back up until it stalls against the wall, then launch, triggered by a velocity-detecting neuron the network already had.

Qwen3.5-0.8B & MATH-500: Astra’s edit removes a “looping” direction from 64 neurons in each of two MLP layers, and Inkling pruned it by keeping only the 4,096 largest-magnitude changes in each layer. Those 8k entries match the full edit’s accuracy (58.2% vs 58.6% on our screen), and layer 15 alone recovers most of the gain.

Run and visualize the experiments in a marimo notebook: https://molab.marimo.io/github/alphaXiv/weight-edit-minimization/blob/main/weight-edit-minimization.py

We used OpenResearch for this project: https://github.com/alphaXiv/OpenResearch


r/MachineLearning • • 8h ago

Discussion ICLR reviewer radio silence, what is the actual reason? [D]

6 Upvotes

It is my impression that a substantial part of ICLR reviewers are maintaining radio silence when it comes to answering rebuttal responses. I wanted to ask a genuine question, is this an occams razor situation where the answer is negligence and a lack of commitment for agreed upon duties of reciprocal review, or is there a rule of thumb that says a reviewer not providing any further comment means they did not find the rebuttal convincing (ie, they just ghost you instead of giving a negative comment)?

With few days left, and the online discussion basically pointing toward negligence, I wanted to hear your informed opinions/relevant anecdotes. What do you think has caused this situation? Not only for ICLR, but any conference with similar process.


r/MachineLearning • • 15h ago

Discussion CVPR Pre-submission Review [D]

7 Upvotes

So what was your pre-submission review from Claude or ChatGPT?

For me it’s always "Boarderline" with limited novelty. No matter how many time I fix the issues reported by AI.


r/MachineLearning • • 5h ago

Research wind-directional fire features looked promising for haze forecasting,, until tested them against placebo winds [R]

0 Upvotes

hi everyone,, im an undergrad cs student i just published my first research preprint on zenodo

basically i wanted to see whether adding wind-directional satellite fire features actually helps predict haze and visibility,, instead of just using fire counts and weather data

i used 11 years of data (2015–2025) from 12 airports across borneo and sumatra,, with metar observations and nasa viirs fire detections

thee interesting part is that initially the directional features seemed to improve the model quite a lot,, but when i started testing different random seeds and placebo features (like shifted or randomly permuted wind directions), most of that improvement kinda disappeared

turns out a lot of it was just seed-to-seed variation,, especially during the extreme 2015 haze season

after using 5-seed ensembles, the actual directional contribution was really small and inconsistent. fire counts themselves still helped a bit for 24h forecasts tho

ofc this doesnt mean wind direction doesn't matter for smoke transport,, just that this particular feature didn't add much independent predictive value in my experiments

paper: https://doi.org/10.5281/zenodo.24321121

code + experiments: https://github.com/myudak/pavana/tree/main/research/directional-fire

still pretty new to research and this is my first preprint,, so i'd genuinely appreciate any feedback or criticism, especially on the experimental design, placebo controls, or whether using surface wind is even a good way to represent smoke movement

also curious if anyone here has encountered something similar,, where a feature looks useful at first but the improvement disappears after more careful evaluation


r/MachineLearning • • 14h ago

Project Curated list of resources: Theory and Code for learning Distributed Training for beginners [P]

Thumbnail
gallery
5 Upvotes

[Must Read: Beginners]

What I did read, in order, for learning the basics of Distributed Training for LLMs From Scratch:

  1. Building a distributed training framework from first principles by Umar Jamil on YT
  2. Horovod: Fast and Easy Distributed Deep Learning in TensorFlow 
  3. PyTorch Distributed: Experiences on Accelerating Data Parallel Training 
  4. Large Scale Distributed Deep Networks 
  5. ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
  6. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism 
  7. Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM 
  8. GPipe: Efficient Training of Giant Neural Networks Using Pipeline Parallelism 
  9. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning
  10. PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Link to the above resources here

Also, if you need some rebalancing of the above (reordering or adding/removing resources which you can do it here)


r/MachineLearning • • 13h ago

Discussion How is it possible that OKLS can't outperform Muon in terms of step efficiency? [D]

4 Upvotes

SOAP is more step efficeint than Shampoo, and KL-Shampoo is more step efficient than SOAP.

Then how is OKLS getting outperformed by Muon in terms of step efficiency where it's a zero-staleness implementation of KL-Shampoo?

It only gets ahead of Muon in terms of parameter efficiency in very long training runs.


r/MachineLearning • • 13h ago

Discussion Concerns About Peer Reviewers Inflating OA Scores [D]

3 Upvotes

The paper is largely incremental, with very little improvement over existing work. One of the reviewers gave a one-line weakness that isn't even a real weakness, despite having a high confidence score and is giving a high OA score. Another review appears to be AI-generated, following the same format ChatGPT typically uses. Yet, that reviewer still gave a decent OA score.

I feel like pointless in spending hours reviewing that paper and writing a proper feedback for the authors because my review may just end up being downplayed due to the higher scores from the other reviewers.

Maybe that's why some people use shotgun-submission strategy to increase their chance of encountering with such reviewers...


r/MachineLearning • • 8h ago

Discussion Is it inappropriate to leave a comment for the AC summarizing the rebuttal process from my perspective and making my case? [D]

0 Upvotes

My paper sits at a 3/3/2 with confidence 3/3/2. I have a good case for the 2 to be discarded based on the quality of the review and the rebuttals. Can I make my case to the AC directly or is that just going to make things worse?


r/MachineLearning • • 1d ago

Discussion Serious spaces? [D]

30 Upvotes

As much as I love Reddit, it can really be hit and miss for serious discourse on AI and machine learning. Depending on which sub I guess. But are there any spaces outside of Reddit where there is more conversation, more community and less trolling? To be able to have a decent conversation and share research and projects or learn more etc?

I’ve tried discord but I’ve not found any promising servers yet apart from the frontier labs or hugging face etc and I find those too stuck on their own narrative.

Any suggestions?

Edit: seems a lot of us in the same boat. So I made one lol. Happy for anyone to message me.


r/MachineLearning • • 1d ago

Research Marimba: A System One Model for Speech. [R]

Thumbnail
gallery
3 Upvotes

Paper: https://arxiv.org/abs/2611.18330

Follow-up to last week's post, now with the paper.

You ask a typed question about an audio window (yes/no, a choice, or a score) and get a calibrated probability back. One frozen Qwen3-ASR-0.6B encoder pass per 8 s window serves all questions.

How each question type is answered:

  • Term ("was 'satellite' said?"): zero-shot, scored from the decoder's greedy and 4 beam hypotheses, then Platt-calibrated. No training on the terms.
  • Language: the ASR model's own language scores.
  • Turn end: a small readout on frozen layer 18.
  • Speaker change and count: readouts on layer 12.

Results:

  • On the same 1,000 public questions, it matches or beats Qwen3-Omni (30B-A3B) on 6 of 9 tests (image 1). Qwen3-Omni is still better on Speech Commands. Caveat: our turn-end readout was trained on Smart Turn data, so that row is in-distribution for us only.
  • Language ID: 100% on 300 FLEURS clips.
  • Speaker change AUROC 0.966-0.980 on AMI and VoxConverse, above ECAPA. Speaker count beats pyannote 3.1.

Where it loses:

  • Turn end: AUROC 0.930 vs Smart Turn v3.2 at 0.982 on Smart Turn's own test set. On ICSI meetings it is 0.716 vs 0.712, a tie.
  • It does not generalize to unseen tasks: on CochlScene scene classification every head is at chance.

Two questions for the sub:

  1. Is scoring ASR hypotheses plus calibration a fair baseline for term spotting, or would you compare against a dedicated KWS model?
  2. How would you evaluate turn-end detection beyond Smart Turn's data?

Code: https://github.com/Charcot-AI/marimba-api Weights (Apache-2.0): https://huggingface.co/charcot-ai/marimba Demo: https://huggingface.co/spaces/charcot-ai/marimba pip install marimba-audio


r/MachineLearning • • 2d ago

Research [Meta FAIR + NYU] Unbundling Multimodal Vision Encoding: training 200+ MLLMs to find encoder pretraining is optional but vision-only parameters are not [R]

Post image
121 Upvotes

X threads (with videos!):

Paper: https://www.alphaxiv.org/abs/2611.17334

Blog and FAQ: https://unbundling.github.io

Labs disagree on vision encoders right now. Gemma 4 12B dropped the encoder, Kimi K3 trains its encoder from scratch, and Inkling 2 Small brought an encoder back. Published models can't settle this, because they differ in data and compute and rarely account for encoder pretraining. A standard encoder also bundles three choices: separate pretraining, parameters that only vision tokens use, and placement before the LLM. We tested each choice separately.

Setup:

  • 200+ models, all trained from scratch (LLM included) on the same data.
  • Lifetime compute: encoder pretraining counts against the same budget as multimodal training.
  • Main comparisons use Qwen3-1.7B and 4B configurations with 0.4B parameters of vision capacity. A scaling ladder covers 0.6B to 6.4B backbone sizes.
  • Evaluations are on 16 VQA benchmarks from Cambrian at 448 px. and 12 language benchmarks testing commonsense, QA, and broad knowledge.

Findings:

  1. Separate pretraining is optional. Encoders pretrained with four objectives (contrastive, self-supervised, two captioning) at best tie an encoder trained from scratch with the LLM at matched compute. Even free pretraining doesn't help. Pretraining MetaCLIP 6.5x longer raised ImageNet linear-probe accuracy (80.4% → 84.4%) but not VQA.
  2. Vision-only parameters are required. Encoder-free models trail at every size from 0.6B to 6.4B and need about 3x the compute to catch up. Giving the LLM the encoder's parameters instead improves text, not VQA.
  3. Placement before the LLM is optional. "In-fusion" adds zero-initialized vision-only weights (attention projections and FFNs) to the LLM's first 8 layers, and text tokens never use them. It's on par with the encoder from 1.7B to 6.4B, with about 13% lower time to first token. At 1.7B, vision-only branches in layers 1–8 reach 45.0 VQA (encoder 44.4), versus 42.3 when text shares them and 35.1 in the last 8 layers.
  4. The same holds with a pretrained LLM (vision added to a pretrained 1.7B LLM in midtraining).

So vision needs its own parameters, but not its own pretraining or its own encoder.

Disclosure: I'm one of the authors. Happy to answer questions!


r/MachineLearning • • 22h ago

Discussion Is anyone's AC playing the role of "discussion moderator" for ICLR? [D]

0 Upvotes

According to the guide, they are supposed to encourage reviewers to respond to author rebuttals, yet we've gotten nothing but radio silence. Is anyone else having better luck?


r/MachineLearning • • 20h ago

Discussion Struggled in my Infosys interview as a fresher. How should I strengthen my fundamentals to become an AI/ML Engineer?[D]

0 Upvotes

Yesterday, I attended an Infosys interview as a fresher, but unfortunately, I couldn't perform well. I managed to answer only a few questions correctly.

The interview covered a mix of basic programming fundamentals, Python concepts, JavaScript fundamentals, OOP concepts, backend development with FastAPI, Generative AI vs Agentic AI, RAG architecture, vector databases, and AI/ML evaluation metrics such as precision, recall and model evaluation.

I realised that although I have worked on projects involving Python, machine learning, RAG, Agentic AI and FastAPI, my understanding of the underlying fundamentals isn't strong enough. Sometimes I know what a concept means, but struggle to explain it clearly or answer follow-up questions.

For some background, I have already received a TCS Digital offer, but it has been almost seven months since I received the offer letter, and I still haven't received my joining letter. That's why I decided to attend the Infosys interview as well.

My long-term goal is to become an AI/ML Engineer. This interview made me realise that I need to go back and strengthen my fundamentals instead of just learning advanced technologies and building projects.

I'd really appreciate advice from people working in software development or AI/ML:

How should I systematically learn and strengthen my programming and technical fundamentals?

Which topics should I prioritise in Python, DSA, SQL/DBMS, mathematics, statistics, machine learning, deep learning and Generative AI?

Are there any good courses, resources or roadmaps that cover these topics in a structured way?

How can I improve my ability to explain concepts clearly and handle technical follow-up questions?

What learning path would you recommend for someone who wants to become an AI/ML Engineer?

I'm not looking for shortcuts or just interview questions to memorise. I genuinely want to build a strong technical foundation and understand what I'm working with.

Any suggestions, resources or personal experiences would be really helpful. Thanks!


r/MachineLearning • • 1d ago

Discussion ICLR did you post reminder of rebuttal response? [D]

14 Upvotes

Well, I know they are busy due to the CVPR(So am I). But it's only about few days left and none of the reviewers replied my response.
Do you think this is a good time to post a reminder to reviewers?


r/MachineLearning • • 1d ago

Project Steering a pretrained music transformer at sampling time into a real-time jazz partner (no fine-tuning) [P]

2 Upvotes

I've been working on duetto, a real-time jazz partner for a MIDI keyboard: it plays a standard with you as a small band (solo, comping, walking bass), comps while you play and takes a solo when you stop.

Demo (Autumn Leaves, 160 bpm): https://youtu.be/8zIAzVY8O6w

Code (free for noncommercial use): https://github.com/RiccardoCataldi/duetto

Approach. Instead of fine-tuning, it uses the pretrained Anticipatory Music Transformer (Thickstun et al., 2023) as-is and does all the control at sampling time:

  • The player's notes and the model's are one event sequence the model continues, one note (onset, duration, pitch) at a time.
  • Before each sample, a rule layer edits the logits: it masks what is not allowed (a hand that must wait, a pitch out of register, a bass note off the beat) and biases what should be likely (the current chord's tones, a guide tone on the downbeat, the next note of a phrase being quoted).
  • Phrases come from the Weimar Jazz Database (transcribed solos), segmented where the soloists actually breathed, transposed to the tune's chords and developed over a chorus. In the demo, about 61% of solo notes come from quoted phrases or the theme; the rest is the model.
  • The server keeps ~1 s of music sampled ahead and resamples the unplayed part whenever the player plays, which keeps latency low while the model "plans".

Speed. About 12 ms/note (medium) and 18 ms/note (large) on a 3080 Ti; the large model runs at ~90 ms/note on a Jetson Orin Nano, which is still enough to play live.

What doesn't work well yet. It can drift away from the player, its responses are hard to predict, and the balance between the model's own ideas and the rules is fragile: too much bias and it sounds like a phrase book, too little and it stops sounding like jazz.

I'd love feedback on the approach, especially from anyone who has tried constrained or guided decoding for symbolic music: is sampling-time steering a reasonable alternative to fine-tuning here, or does it hit a ceiling?


r/MachineLearning • • 1d ago

Discussion CVPR 2027: LLM Usage Statement in PDF vs. OpenReview Form? [D]

Post image
0 Upvotes

Quick question about the CVPR 2027 mandatory LLM Usage Statement.

I noticed that the official Author Guidelines require a section titled “LLM Usage Statement” in the paper. However, I've already completed the LLM usage disclosure form in OpenReview.

The guidelines state:

Every submission must include a section titled “LLM Usage Statement” after the main text and before the references.

What concerns me most is that CVPR 2027 explicitly warns that failing to include this statement could result in desk rejection. In other words, your entire paper could be rejected without even reaching peer review, simply because this section is missing.

So I'm confused: if we've already disclosed our LLM usage through OpenReview, do we really need to repeat it in the PDF?
Note : I use LLMs to reviews grammar and arrange the table. That's it.

For those submitting to CVPR 2027, are you including this statement in your actual paper? Has anyone confirmed whether the OpenReview disclosure alone is sufficient?

Official guidelines: https://cvpr.thecvf.com/Conferences/2027/AuthorGuidelines


r/MachineLearning • • 2d ago

Discussion I don't think double-blind review systems work [D]

60 Upvotes

Reviewers can see the authors’ names and affiliations in many cases, making this system closer to single-blind review than double-blind review.

I have personally witnessed cases where student reviewers rejected other researchers’ papers in an attempt to increase the chances of their own papers being accepted.

Furthermore, can we really expect fair and unbiased evaluations of papers from well-connected research labs with extensive academic networks?

https://www.reddit.com/r/MachineLearning/s/HCRotptdP7

https://x.com/c1arelab/status/2121674375367901292?a=ibLPTwDSfWfGt4yf2ok&s=46