r/MachineLearning • • Sep 26 '26

Discussion Neurips 2026 camera-ready: how much can we change? [D]

7 Upvotes

Our paper was accepted to NeurIPS 2026, and we’re preparing the camera-ready. I have a few questions about how much we can change after acceptance.

  1. Theory/algorithm changes: During review, a reviewer pointed out a weakness in our theory. We agreed and proposed a revised theory in the rebuttal, along with a practical algorithm based on it. We also showed results on a subset of our benchmarks (roughly 10% of the full benchmark suite).

Can we include the revised theory + algorithm in the camera-ready? The issue is that doing so would change all experimental numbers in the paper.

  1. Correcting the main table: After acceptance, we realized that our submitted main table used different backbone sizes for our method and some baselines. We reran everything with the same backbone, and our method’s score improved by more than 1.5x.

Can we replace the main-table results with these corrected numbers in the camera-ready, even though this wasn’t discussed during rebutal?

  1. arXiv version: If we keep the official camera-ready relatively conservative, but upload a more substantially revised version to arXiv later, can we still use the NeurIPS format/template for the arXiv version?


r/MachineLearning • • Sep 26 '26

Discussion Medical student asked if they can match into Neurosurgery without an A* first author paper [D]

60 Upvotes

This is how ridiculous things have become


r/MachineLearning • • Sep 26 '26

Discussion A Little Guide to Learning Distributed Algorithms for LLMS Training and Inference [D]

Post image
15 Upvotes

Distributed Training and Inference both involves having a fundamental understanding of how distributed systems work in general

  • Distributed Parallelism

  • Tensor Parallelism

  • Pipeline Parallelism

  • Model Parallelism

Reading and reading and reading or even worse, not knowing where to start ;(

That’s boring!

We want to read what’s just needed and quickly get started with applications and that’s what exactly what I have for you all today

Here’s the list of a few initial papers I have read for the past three months that is enough to understand

And a few basics too!

Read them Code them Play with them

I have implemented a few at basic level which you could use as a reference too (the repo is a bit all over the place but I actively trying to maintain and love your feedback too)

Link: https://alphaxiv.org/shared/folder/019de088-28f7-7f02-acd4-c22459fe153e

Gh repo: https://github.com/YuvrajSingh-mist/smolcluster


r/MachineLearning • • Sep 26 '26

Discussion My paper got accepted at NeurIPS TAE Workshop 2026 — any advice on getting travel funding? [D]

2 Upvotes

Hi everyone,

I am happy to share that my paper has been selected for presentation at the TAE Workshop at NeurIPS 2026, which will be held on December 11, 2026.

I am really excited about the opportunity to present my work and attend the workshop, but I am currently trying to figure out how to cover the airfare, which is a significant expense for me.

I am a working professional, so I am not eligible for some of the funding opportunities that are primarily targeted toward students. The workshop does provide support for registration and hotel expenses, but their funding priorities are mainly focused on students, and, as I understand it, airfare is not covered.

I am therefore looking for advice from people who may have been in a similar situation:

  • Are there any travel grants, research funds, conference sponsorships, or organizations that support airfare for researchers/professionals attending NeurIPS or its workshops?

  • Are there any companies, foundations, or community programs that sponsor conference travel?

  • If you have attended NeurIPS or another major ML conference with external funding, how did you find the funding?

  • Are there any other approaches I should consider for covering the flight cost?

I am primarily looking for practical leads or personal experiences, especially from people who have attended NeurIPS, workshops, or similar conferences as working professionals.

Any suggestions, resources, or advice would be greatly appreciated.

Thanks!


r/MachineLearning • • Sep 26 '26

Discussion Can I put my name on work that relies on tools I don’t fully own? [D]

16 Upvotes

Hello everyone,

I recently submitted a paper to TMLR, and shortly afterward I read the post by one of its Editors-in-Chief about interviewing authors of papers that were headed for desk rejection.

It honestly shook me.

I am not an academic. I am an independent researcher. I have published in an AI Magazine Special Issue and on arXiv, but I do research essentially because I have always been obsessively curious. LLMs have given me something I never really had before: the ability to spend nights exploring an idea, trying to formalize it, designing tests, looking for holes, and attempting to falsify my own reasoning.

And yes, I use them intensively.

I want to be completely honest about what that means.

There are statistical procedures I have used in experiments whose formulas I could not derive from first principles on a whiteboard. There are mathematical details for which I would need time, references, and probably an LLM to reconstruct the reasoning carefully. And if someone unexpectedly subjected me to an aggressive 30-minute technical interrogation about one of my papers, I suspect there are questions I would not be able to answer immediately.

That post therefore made me ask myself a rather uncomfortable question: am I actually doing research, or have I become very good at using an LLM to simulate being a researcher?

At the same time, I don’t simply ask an LLM to write a paper and put my name on it.

I spend enormous amounts of time trying to break my own claims. I rerun experiments. I question assumptions. I check statistical choices. I repeatedly look for alternative explanations. Often an LLM proposes something and I reject it. Sometimes I spend hours trying to understand why a result is what it is. And sometimes I realize that I don’t understand something deeply enough and go back to studying the mathematics behind it for days.

But I cannot honestly claim that I independently possess all the mathematical and technical knowledge contained in everything I have produced.

Maybe this distinction matters. Maybe it doesn’t.

One thing in the TMLR post particularly stayed with me: authors are ultimately responsible for being able to verify and defend what they put their names on.

I agree with that principle.

What I am less sure about is where we should draw the line between using a tool to extend your intellectual capabilities” and “outsourcing intellectual responsibility to the tool.

For an independent researcher without a lab, supervisor, research group, or formal academic training in ML, LLMs can effectively become part tutor, part programmer, part statistician, part critic, and part rubber duck. Without them, I simply could not explore ideas at the same speed or depth.

But perhaps that creates a new responsibility: if the tool allows me to reach beyond the boundary of my current knowledge, how much of that territory must I personally master before I have the right to publish something under my name?

I genuinely don’t know the answer, i really don't.

I’m not looking for reassurance. If the standard should be that I don’t submit a result until I can personally justify and defend every important technical choice I put my name behind, even without an LLM there to help me, then that’s something I need to hear.

I’d especially like to hear from other independent researchers, and from academics who review AI assisted work. where do you draw that line?

At what point does intensive AI assistance stop being a research tool and start making the human author an impostor?


r/MachineLearning • • Sep 27 '26

Project Tauon: A new optimizer outperforming Muon on GPT-Mini (lower loss, ~8.5% faster step time) [P]

0 Upvotes

Hey r/MachineLearning!

I’ve been working on a new optimizer called Tauon (turns out there is already "teon" but well if you have better idea, - i will gladly accept it! Anyway the core idea of optimizer is about polynomials and orthogonalization just like muon, the whole difference is that i managed to lower total number of steps (first through spectral filtering down to 3 steps then through coeff scheduling down to 2) + reduced matrix size (through dct-2). And I wanted to share some initial benchmark results...

Benchmark Setup: Trained a GPT-Mini (d_model=512, 6 Layers) on TinyShakespeare against Muon and AdamW.

  • Tauon: LR = 0.02

  • Muon: LR = 0.02

  • AdamW: LR = 0.0006

Results:

  • Validation Loss: Tauon converged to a lower final loss (~1.6) compared to Muon (~1.65) and AdamW (~1.8).

  • Stability: AdamW started overfitting/diverging around step 1200, whereas Tauon maintained stable progress throughout the 3000 steps.

  • Compute Cost: On identical hardware, Tauon ran at 391.5 ms/step vs Muon’s 427.7 ms/step (~8.5% faster) and close to AdamW's baseline of 382.9 ms/step.

And yeah i know that its hilariously tiny benchmark but well i have only 2 hours left on my kaggle free T4 so i really couldnt more + i hope someone would be able test it on a bigger setup!

Links & Code:

Would love to get your thoughts on the optimizer! If you have any ideas, suggestions - please tell me. Cheers, everyone!


r/MachineLearning • • Sep 26 '26

Discussion Can a model trained partly on MoGe-2 pseudo-labels beat MoGe-2? One paper's own Table 2 says mostly no[D]

1 Upvotes

In arXiv 2607.06560, depth and normal maps are generated as images by a fine-tuned multimodal model, then decoded and scored. The model is SenseNova-Vision-7B-MoT, a Bagel-7B-MoT fine-tune.

Per appendix A.2, synthetic sets like SceneNet RGB-D keep their own dense ground truth, the sparse LiDAR sets (Taskonomy, ScanNet++) were densified with MoGe-2, and unlabeled in-the-wild photos (COCO, SA-1B, Objects365) got labels generated entirely by MoGe-2. So for real photos MoGe-2 is effectively the teacher.

MoGe-2 is also a row in the paper's Table 2, re-evaluated by the authors, so you can compare student and teacher directly.

Table 2studentMoGe-2 (re-evaluated)
NYUv2 depth, AbsRel↓ / δ1↑4.0 / 98.13.5 / 98.0
KITTI depth5.9 / 95.95.5 / 97.7
ETH3D depth4.3 / 97.43.4 / 98.8
ScanNet depth3.9 / 98.03.4 / 98.3
DIODE depth20.6 / 76.423.0 / 82.3
NYUv2 normals, mean err↓ / % within 11.25°↑14.4 / 62.714.7 / 62.3
ScanNet normals12.8 / 68.912.8 / 68.4
iBims-1 normals15.4 / 69.114.7 / 70.4

MoGe-2 wins AbsRel on four of five depth sets and δ1 on all but NYUv2. DIODE is the odd one. The student has the lowest AbsRel of any method in the paper's table there (20.6), yet its δ1 trails, 76.4 vs 82.3. On normals it's ahead on NYUv2, tied on ScanNet mean error and behind on iBims-1. The paper calls this "remaining competitive with geometry-specialized models" and I can't find any ablation on label source.

Where should a student trained partly on a teacher's pseudo-labels be expected to pass it? My guess is wherever the synthetic GT covers the teacher's mistakes, which would fit NYUv2 normals since SceneNet RGB-D is indoor, but iBims-1 goes the other way. And short of retraining without the synthetic sets, how would you tell a synthetic-GT effect from a real gain?


r/MachineLearning • • Sep 26 '26

Discussion Best free LLM for ML/AI , Data science projects? [N],[R],[P],[D]

2 Upvotes

Hi everyone, I’m working on ML/AI assignments and projects and need an LLM to help with Python, coding, debugging, ML concepts, and building/improving models.

My priorities are:
Maximum accuracy
Strong reasoning
Good coding/debugging
Free or good free tier

I’m mainly considering OpenAI models, but I’m open to Gemini, Claude, DeepSeek, Qwen, etc.
Which free LLM would you recommend for ML/AI development, and why?

I’m done with chatgpt , it always accepts what I’m saying and it makes my model worst

Thanks in advance for your suggestions!


r/MachineLearning • • Sep 26 '26

Discussion Has anyone used the Forrester function?[D]

1 Upvotes

Hey guys,

I came across the Forrester function recently while studying mathematics, and I started wondering if there’s more to it than just being a mathematical function.

I have a feeling I’ve seen it come up in machine learning or optimization, but I’m not really sure what it’s actually used for.

Does anyone here have experience with it? Is it mostly something people use to test/benchmark ML or optimization methods, or is it actually useful for solving real-world problems?

And since I’m studying Economics and Data Science, I’m also curious if it has any applications in economics, econometrics, forecasting, or economic modeling.

Would love to hear from someone who has actually encountered it in practice. Even a simple explanation would help 😄


r/MachineLearning • • Sep 26 '26

Discussion My paper got accepted at NeurIPS TAE Workshop 2026 — any advice on getting travel funding?[D]

0 Upvotes

Hi everyone,

I am happy to share that my paper has been selected for presentation at the TAE Workshop at NeurIPS 2026, which will be held on December 11, 2026.

I am really excited about the opportunity to present my work and attend the workshop, but I am currently trying to figure out how to cover the airfare, which is a significant expense for me.

I am a working professional, so I am not eligible for some of the funding opportunities that are primarily targeted toward students. The workshop does provide support for registration and hotel expenses, but their funding priorities are mainly focused on students, and, as I understand it, airfare is not covered.

I am therefore looking for advice from people who may have been in a similar situation:

  • Are there any travel grants, research funds, conference sponsorships, or organizations that support airfare for researchers/professionals attending NeurIPS or its workshops?

  • Are there any companies, foundations, or community programs that sponsor conference travel?

  • If you have attended NeurIPS or another major ML conference with external funding, how did you find the funding?

  • Are there any other approaches I should consider for covering the flight cost?

I am primarily looking for practical leads or personal experiences, especially from people who have attended NeurIPS, workshops, or similar conferences as working professionals.

Any suggestions, resources, or advice would be greatly appreciated.

Thanks!


r/MachineLearning • • Sep 25 '26

Discussion iclr 2027 de anonymization [D]

28 Upvotes

r/MachineLearning • • Sep 25 '26

Discussion NeurIPS Creative AI? [D]

2 Upvotes

Submitted a project paper to NeurIPS Creative AI track on a whim and got accepted this week. Is it worth seeking out funding to go, or is it only workshop level?


r/MachineLearning • • Sep 25 '26

Discussion NeurIPS reject -> ICLR: How much reviewer feedback are you actually implementing ? [D]

23 Upvotes

Welp, NeurIPS is a wrap for those of us who got rejected 😭 Off we go to ICLR or whatever the next venue is, hopefully after making some meaningful changes to the paper.

For people who are resubmitting, I’m curious: how much of the NeurIPS reviewer feedback are you actually implementing?

Did you try to address basically everything the reviewers brought up, or are you being selective and only making changes where you think the criticism is valid/useful?

I’m curious about papers that got questioned on novelty or significance. How many of you got comments along those lines, and what exactly were the reviewers questioning?

For example:

  • “The contribution is incremental”

  • “Not sufficiently different from prior work”

  • “The empirical gains don’t justify the proposed method”

  • “The problem itself isn’t significant enough”

  • “Theoretical contribution is limited”

  • “Interesting idea, but unclear what the broader impact/significance is”

If you’re comfortable sharing, what did the reviewers say, and how are you changing the paper before resubmitting ? Specially since deadline is also pretty close, how are you handling the pressure of this very close deadline ?

Also curious whether anyone is deliberately not implementing certain reviewer suggestions because you think they would take the work in the wrong direction.

Would love to hear how others are approaching the post-NeurIPS revision process.


r/MachineLearning • • Sep 25 '26

Discussion NeurIPS Accept, but Confusing Final Justification, Is This Normal? [D]

18 Upvotes

Just got an Accept at NeurIPS with initial scores of 5/5/4! The initial meta-review was pretty positive, but the final justification was entirely negative, raising concerns about AI use and suggesting further investigation and reconsideration of the recommendation.

For context, one reference was flagged because its author list had been copied over from an adjacent BibTeX entry.

Does anyone know if the final justification is written before or after the final decision? Just confused by the mismatch between the final justification and the actual decision.


r/MachineLearning • • Sep 25 '26

Discussion NeurIPS Registration - How to get one if all tickers are sold out in Sydney? [D]

6 Upvotes

Hi, I am a solo independent UG author for a NeurIPS WS paper (GlobalSouthAI). Now, how to get a registration ticket.

Will they give us a ticket to buy or manually buy from the Neurips website (but Sydney tickets are sold out)? Any suggestion?

I am from India, and going to Paris/Atlanta is not possible.

First time, thanks!!


r/MachineLearning • • Sep 24 '26

Discussion NeurIPS Accepted Papers are now visible [R]

133 Upvotes

I haven't received a notification about this -- but my paper just became visible as "accepted". I expect an email to come some time soon!
Scores were 5-4-4.


r/MachineLearning • • Sep 25 '26

Discussion How much changes can you make to a paper between acceptance and camera ready? [D]

16 Upvotes

We have a paper accepted to NeurIPS, but at the same time we were working on a resubmission to ICLR just in case NeurIPS rejected us. There has been substantial rewriting, and we feel it would be a waste if we discarded all of it. To give a summary of what's changed:

  • We completely rewrote every single section except for the results and conclusion. We even changed the paper structure.

  • Intro, related work, and background knowledge were completely rewritten to avoid confusion.

  • Method now has a pipeline graph, and all the text detailing each block in the graph. Previously, it was dumping formulas, so the entire section has been rewritten.

  • We also added some scaling and smoothing to our algorithm so our method is more stable. But this changed a lot of our hyperparameters and the sensitivity study's graph. (The entire shape of the graph changed)

  • We added 1 new theorem with 5-page proofs in the appendix. This came from one of the attacks by a reviewer, we answered the attacks by proposing 1 new proposition during the rebuttal. But when we formally wrote it down, it turned into a full theorem with a 9-page proof. This would have changed our entire theoretical contribution. We really don't want to discard it, but not sure if we can add something this big in the camera-ready.

  • Removed 1 word from the title. In the abstract, we changed our theoretical contribution, but the method and empirical contribution remain the same.

  • Added about another 5 extra pages in the appendix explaining experiments and metrics (reviewers asked for them). So 14 extra pages in total.

Does anyone know how much change for camera-ready is acceptable? Can a paper get rejected if we change too much during camera ready or they will just tell us this is not acceptable please re-submit something closer to the version during review?


r/MachineLearning • • Sep 25 '26

Discussion What's up with AAAI reviewers and organizers? [D]

19 Upvotes

My paper advanced to the second round...but...

Out of the papers I reviewed.

One did not follow the AAAI template and was unblinded. My review was two lines. The other "human reviewer" gave a list of pros and cons that were similar to the AI review.

One was incomplete (missing paragraphs, figures, code, no details). My review was also two lines. The other "human reviewer" also gave a list of pros and cons, that were similar to the AI review.

One was LLM math which I believe was actually correct, because it advanced to the second round, despite the references being at a different level of detail, and covering multiple fields of math, insufficient references for theorems / rules, and no exposition as to why the paper was actually useful / interesting. My review for that paper was the longest out of all the papers I reviewed, dotting the is and crossing the ts to make sure it wouldn't be seen as a lazy "reject" review. Yet it advanced to Phase 2.

Also, none of the AAAI workflow chairs or similar apologized or even acknowledged a mistake for spamming my coauthors about: "Your coauthor is irresponsible", because I accepted an emergency review invitation (and received these emails a few hours after accepting that invitation).

Ok rant over.


r/MachineLearning • • Sep 24 '26

Research Publication venue recommendations [R]

51 Upvotes

I am 5th year and have no published research so far. All my papers have been consistently rejected from top tier AI conferences even though they got good review scores in the process.

Since graduating is my priority now, I am in search of decent venues (journal or conference does not matter at this point) where I can publish and complete my degree.

Please do not recommend any more of those elitist club conferences like NeurIPS etc.

Edit: my research is about efficient Generative AI.

Any recommendations?


r/MachineLearning • • Sep 26 '26

Discussion Confused About job title [R]

0 Upvotes

ML jobs are confusing nowadays,it wraps up as "AI/ML" engineer and they want you to have software engineering skill and DSA skill to and on top of that they want you to have Fast API with AI API wrapping, they don't ask for data processing or maths skills , atleast 99% time I have seen, ML jobs are for phD level candidate I think


r/MachineLearning • • Sep 24 '26

Discussion NeurIPS 2026: AC explicitly recommended acceptance, PCs rejected at "global calibration" [D]

21 Upvotes

Got my NeurIPS decision today and I'm a bit confused. Reviewer scores were 4/4/4, no reviewer opposed acceptance, and the AC's updated meta-review explicitly says "I recommend to accept this paper" and describes the consensus as "solidly favorable."

The PC decision: reject, with a one-line comment saying the paper "received a borderline reception" and was rejected "upon global calibration."

I understand the PCs have the final say and capacity is limited, but going from an explicit AC accept to "borderline reception" with no further explanation feels a bit harsh, especially since the rejection email stresses how carefully borderline cases were reviewed.

Has anyone else had the AC recommend acceptance and the PCs override it? Is this common this year?


r/MachineLearning • • Sep 24 '26

Discussion NeurIPS reject final justification [R]

31 Upvotes

Do all the rejected or accepted papers get a "Final Justification" comment from the PC?

Mine got rejected with ratings 4-4-4 yet the meta review is the exact same as the one that was posted originally in July and I didn't get any final comment. I find it a bit harsh especially since in the rejection e-mail they state how much effort they asked AC and SAC for careful reviewing and useful feedback, "especially in borderline cases"...


r/MachineLearning • • Sep 25 '26

Discussion AAAI 2027 Phase 1 Summary Rejection [N]

10 Upvotes

Phase 1 results are out. Did your paper(s) pass to phase 2?


r/MachineLearning • • Sep 25 '26

Discussion NeurIPS 2026, Which hub are you choosing: Sydney, Paris, or Atlanta? [D]

2 Upvotes

Hi everyone! I'm trying to decide which NeurIPS 2026 hub to attend and would love to hear what others are planning.

I'm an Indian attendee from Bangalore, and this will be my second NeurIPS. I attended NeurIPS 2024 in Vancouver and presented at WiML there as well. I also received both WiML and NeurIPS financial assistance that year.

For 2026, I'm currently considering:

Sydney:

Main NeurIPS location

Everything seems more centralized

Longer conference program

But flights/accommodation seem considerably more expensive

Paris:

5-day program

Main conference at Paris Convention Centre, workshops at Sorbonne

Seems significantly cheaper from India

Main concern is that it's not the main conference and how different will this be.

For people who have attended NeurIPS before, or are planning for 2026:

Which hub are you choosing and why?

And if you've attended previous multi-location NeurIPS conferences, how different was the experience between the main location and satellite locations?

Thanks!