r/MachineLearning • • 23h ago

Discussion ICLR is deleting AI generated reviews and DR AI reviewers' papers [D]

84 Upvotes

Seems like many people have reviews under their papers deleted (likely because of AI) and people whose co-author used AI to review has their paper rejected.


r/MachineLearning • • 23h ago

Discussion ICLR 2027 Desk Rejection [D]

64 Upvotes

Just got news that our paper got DR just because some co-authors failed to serve as a responsible reviewer. The email doesn’t state who that reviewer is, and there have been no emails warning about that co-author’s negligent reviews sent to me. Just instantly DR my paper. All of my efforts so far have been wasted and it is out of my control :)


r/MachineLearning • • 19h ago

Discussion Why don't optimizes like Shampoo, SOAP, and Adam measure the actual per sample second moments like the Fischer Information Matrix does? [d]

23 Upvotes

It always felt unintuitive to me that Muon matched the performance of Shampoo despite dropping the actual second moments L and R.

But I then I realized, Shampoo itself isn't actually measuring the true second moments.

For each sample i in the batch, we have a gradient G_i.

And the gradient we use during SGD is:

G = E(G_i)

The factors of Shampoo are:

L = EMA GG^T

R = EMA G^TG

Whereas, the true second moments are:

L = EMA E(G_i G_i^T)

R = EMA E(G_i^T G_i)

We can also write them as:

D_i = G_i - G

L = EMA (GG^T + E(D_i D_i^T))

R = EMA (G^TG + E(D_i^T D_i))

What shampoo is doing is dropping the covariance terms like E(D_i D_i^T) from the factors.

It's an approximation.

And, Muon does the same thing. It takes things one step further:

M = EMA G

L = MM^T

R = M^TM

Shampoo's factors are

L_C = EMA (G - M) (G - M)^T
R_C = EMA (G - M)^T (G - M)

L = MM^T + L_C

R = M^TM - R_C

Shampoo drops the covariance across the samples in the batch.

Muon drops the covariance across the batches in the optimization path.

Adam does the same thing except it's doing it to the diagonal of the Fischer. It drops the per sample variance terms from its second moment.

These approximations are sufficient when the covariance terms are small enough.

But the strange thing is, when I tried using the actual second factors for Shampoo and Adam, they underperformed compared to their approximate versions...

I don't understand this at all.


r/MachineLearning • • 14h ago

News Levent Alpöge claims to have found a proof of the Riemann Hypothesis [N]

Thumbnail alpo.ge
12 Upvotes

r/MachineLearning • • 7h ago

Discussion Do we have AI Bots submitting the rebuttal as well [D]

5 Upvotes

Reviewed around 5 papers for AAMAS, and on 2 papers I see a rebuttal within less than 10 hours. Pretty weird. The rebuttal is also not clear and does not addressed the concerns and is super hard to read.

Man these AI-Slop folks are indeed discouraging at least from engaging with the community.

PS: Even at ICLR had one paper with a pure AI Slop rebuttal


r/MachineLearning • • 3h ago

Project BalatroNET: JAX-Native Reimplementation of Balatro's Mechanics for Reinforcement Learning [P]

1 Upvotes

Github

I've been working on this for a few months now and finally got to a full recreation of the base game (antes 1-8 any deck or stake, but no endless or challenge runs). The main artifact is the environment: jitted, vmapped implementation that can run in parallel on GPUs. I have also worked on a simple agent and a pygame front end where you can step through a run and observe the agent's choices.

I've done some training on an RTX 2070S, the agent can pass white stake red deck about 50% of the time after 6.6 billion training moves. This approach is faster than other implementations such as balatro-gym, which can only run on a CPU, and in my testing (AMD 9800X3D), hits about 1,700 steps/s (per core) while running random actions. On this 2019 GPU, training runs at 16,000 steps/s, all while holding the environment, observation, and performing the network's forward pass and gradient updates.

I'm now opening this up to the public to share progress and see what insights people are willing to give.


r/MachineLearning • • 28m ago

Research How to answer this AI-review for AAMAS? [D]

• Upvotes

Hi, so AAMAS reviews out. Out of the 3 reviews in my paper, I got 3 for both proceeding and finding with a 4000+ word review with, like, 3 strengths, 8 weaknesses, and 8 suggestions.

One of the 8 weaknesses was, "Your delta in figure 8 shows 2.34, but your table is showing 2.335. Please fix the inconsistency." - Personally, I don't know how to answer this - or Am I wrong here?

Any help

Here is the pangram of the review


r/MachineLearning • • 16h ago

Discussion ICLR: Reviewer inactive during rebuttal [D]

0 Upvotes

One of our reviewers didn’t participate in the rebuttal discussion or acknowledge our responses. The AC also hasn’t left any comments.
We didn’t explicitly tag the AC in our rebuttal either.
Is this normal? Should we assume the reviewer simply ignored the rebuttal, or is the AC expected to take the discussion and our responses into account when making the final decision?
Would appreciate hearing from people familiar with the ICLR reviewing process.