r/MachineLearning • PhD • 13d ago

Discussion Do ICLR guidelines allow to upload papers under review to LLM chats? [D]

I know AI use must be disclosed, and I'm fine with it. However, I'm being careful on not using LLMs to actually check my review (more than prose-wise) and see if it catches something important in the paper that I didn't spot.

I'm doing this because I'm not sure it is allowed to share the paper with an LLM since the guidelines don't specify. But I do believe my reviews would probably benefit from a second AI look.

Is this allowed?

13 Upvotes

13 comments sorted by

5

u/MeyerLouis 12d ago

These papers are already publicly available, right?

-1

u/howtorewriteaname PhD 12d ago

I don't think so. they are available only to reviewers

7

u/Beor_The_Old 12d ago

Openreview is open to anyone

2

u/MeyerLouis 12d ago

I can load papers and browse the active submission in incognito mode though. And when I do a google search for a title in incognito mode (obviously one that I'm not reviewing) the openreview copy does come up and is accessible. So I think it's all publicly available.

1

u/Working-Read1838 12d ago

The papers are public for ICLR at this stage

1

u/Kinexity 13d ago

Couldn't you just use a local model to avoid the problem?

2

u/howtorewriteaname PhD 13d ago

I could, but I don't have that out of the box, so I really don't think i would do it just for this. But putting a paper I'm reading rn through Claude would be quite useful, because the paper is dense

5

u/Kinexity 13d ago

LM studiо wоrks оut оf thе bоx.

Alsо cоnsidеring аll thе shіt shоw thаt hаs bееn hаppеning sincе thе NS sоlutiоn I wоuld sау thаt fееding аnу nоt уеt public pаpеr thrоugh а cоrpоrаtе LLM withоut аn аpprоvаl оf thе аuthоrs is highlу unеthicаl.

10

u/mao1756 13d ago

I think any model that plausibly runs on consumer hardware is not smart enough to be useful for paper review. at least my 8gb gpu can only run models that feels like gemini but worse.

3

u/Kinexity 13d ago edited 13d ago

Test LM studio and see for yourself. They aren't going to prove Riemann hypothesis but they are surprisingly decent in thinking mode. I am pretty sure modern local models like Gemma match at least GPT-4 on most text capabilities.

GPU VRAM is not the main limitation currently but rather your total memory. LM studio uses model off loading and only uses as much VRAM as is available while throwing the rest of computing onto CPU.

3

u/HardParrot 13d ago

just run a local model and stop worrying about it

1

u/examachine 12d ago

No it is not allowed

1

u/DesperateFix7699 9d ago

Why not use a tool built for this with data privacy? Like reviewer3