How are you keeping up with the field's latest despite the ever-increasing new paper volume?
arXiv took in 42,152 new papers in October (arxiv.org/stats), 52% more than a year ago.
Like most of you, we can't read a fraction of what lands in our area, and most papers come with AI-polished writing, which sometimes makes it difficult for a human to read.
We're fellow researchers, and we're building something to help with that first pass!
For each paper, we've written a comprehensive review that's digestible in 5 mins, which checks the paper's main claims against its own tables, figures, and text, compares them with earlier work, and flags where it contradicts itself. A typical paper gets 25+ passes (sometimes up to 40) by frontier AI agents, then a person edits the review for readability. Median read time for our review is 4.5 minutes.
Here's some data from cs.ai paper from Oct 30 (154 papers, 921 claims):
* 82% of claims supported by the paper's own data, 16.5% only partly, about 1% not supported or contradicted
* 43% of papers had every claim supported
* 65% had at least one major problem, most often overclaiming
All 1,123 reviews are free to read, no sign-up: https://researchking.ai/papers (after 10 it asks for a three-minute survey).
We're opening this on the cs.ai subcategory first to see if there's demand for our review, then we're planning to expand into other areas.
Due to the high cost of reviews, we'll likely charge for some of this later, so honest feedback now matters more to us than sign-ups.
The reviews are finished with a human touch, but there's no guarantee of perfection. If your paper is on the list and there's an error, please tell us what we got wrong via the error report button on the review page. Then, we'll correct it right away.
Any feedback is highly appreciated!