Research Bites AI (@ResearchBitesAI) header
Research Bites AI (@ResearchBitesAI) profile picture

Daily feed for trending AI research papers published to https://teapawt.net/t.co/IhlgnXL1us

Joined June 2025
Research Bites AI retweeted
We looked at all arXiv machine learning papers last month. 74% are open source ๐Ÿš€
For my first post, Iโ€™m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-Wโ€ฆ
3
2
6
408
Research Bites AI retweeted
Does your paper contradict itself? We just launched an internal consistency reviewer! It will catch when numbers, terminology, notation, text, or figures contradict each other across a manuscript. For example, an equation that is inconsistent with its plot, a p-value rounded two different ways, or cell dimensions that are inconsistent with reported volume. Try it out today!
2
8
636
Research Bites AI retweeted
Last month, arXiv announced a one year ban for authors who submit papers with unchecked AI use, including hallucinated references. We decided to test how this new policy was working. Using Reviewer3โ€™s reference checker followed by manual verification, we sampled 200 papers submitted to arXiv on June 10th, well after the ban announcement, and found some concerning results: 1 in 4 arXiv papers still contain at least one partially or fully hallucinated reference. Results: - 55/200 (27% of papers) still contained at least one partially or fully hallucinated reference. -29/200 (14%) had more than one. -117 total invalid references were identified. -The most common hallucination was an author mismatch. 25/117 fabricated references contained titles of real manuscripts but fumbled the listed authors. See more below.
2
3
2
15
1,108
Research Bites AI retweeted
One month after the arXiv ban and there are still plenty of hallucinated references.
Last month, arXiv announced they will begin banning authors for one year if they submit manuscripts with unchecked AI generation, particularly hallucinated references. We decided to test how this new policy was working. Using Reviewer3โ€™s reference checker, we sampled 200 papers submitted to arXiv on June 10th, well after the ban announcement, and found some concerning results: - 55/200 (27%) had at least 1 hallucinated reference. - 29/200 (14%) had more than 1. - In total, we identified 117 hallucinated references.
1
4
11
1,072
Research Bites AI retweeted
Last month, arXiv announced they will begin banning authors for one year if they submit manuscripts with unchecked AI generation, particularly hallucinated references. We decided to test how this new policy was working. Using Reviewer3โ€™s reference checker, we sampled 200 papers submitted to arXiv on June 10th, well after the ban announcement, and found some concerning results: - 55/200 (27%) had at least 1 hallucinated reference. - 29/200 (14%) had more than 1. - In total, we identified 117 hallucinated references.
2
5
1
18
3,439
Research Bites AI retweeted
arXiv just announced a one-year ban for authors who submit papers with hallucinated references. The most severe issues in research papers need to be caught before they enter the scientific record. So this week, we rolled out hallucinated reference checks and fatal flaw assessments to all authors on Reviewer3. These tools were previously only available in our journal workflows. AI is making research faster and more accessible. Our goal is to scale verification with it. If your lab, department, or journal wants access, reach out.
10
2
36
4,265
Research Bites AI retweeted
These findings argue against framing AI as a replacement to human reviewers. Instead, they are complementary. AI reviewers can surface major, technical issues to support human judgment.
1
2
11
271
RT @reviewer3com: It's finally out! The first benchmark of a dedicated AI manuscript reviewer. We compared publicly available human revieโ€ฆ
Research Bites AI retweeted
No, AI should not be used to make decisions about manuscripts or "score" novelty or significance. That's not what it's good at, anyways. Data from our benchmark of over 145,000+ comments shows AI focuses primarily on technical verification - like the validity, sufficiency, and transparency of the work. Evaluating contribution is uniquely human.
3
12
31
3,662
Research Bites AI retweeted
Reviewer 2 would still request additional experiments
Ok this figure is pretty intimidating...
2
7
493
Research Bites AI retweeted
Peer review should not be about filtering through slop. We started reviewer3.com to address biases and delays in peer review. But since then, AI has flooded the scientific literature. So, we've expanded into integrity checks. We now catch AI text, hallucinated references, and fatal design flaws. New look below!
2
15
1
64
7,460
Research Bites AI retweeted
More than half of researchers now use AI in peer review, according to Nature. The question is whether AI can actually doanything useful in that process, or whether it just suggests adding a few emdashesโ€ฆ So I tested it. Hereโ€™s what I found ๐Ÿ‘‡ #ad
32
151
16
645
96,708
Research Bites AI retweeted
Had a paper rejected and am feeling salty, so sure, this is sour grapes. But it is *insane* that reviewers treat "I have a substantive philosophical disagreement with the argument of this paper" as a reason to reject.
87
82
31
5,891
407,960
Research Bites AI retweeted
Hallucinated references are showing up everywhere! So we brought our reference checker back. It will: - search each reference - link the ones it can find - flag invalid ones Here's a real example on a paper that was recently retracted by Springer Nature for 24 hallucinated references.
3
13
3
32
4,926
Research Bites AI retweeted
What the reviewers will say about your research paper? Find it out before you submit your paper to a journal. Here is how it works. 1. Go to reviewer3.com 2. Click on โ€œTry it for Freeโ€ 3. Select โ€œauthorโ€ and submit your paper 4. The following 3 reviewers will review your paper. ๐š) ๐’๐ญ๐ฎ๐๐ฒ ๐ƒ๐ž๐ฌ๐ข๐ ๐ง ๐‘๐ž๐ฏ๐ข๐ž๐ฐ๐ž๐ซ โž This reviewer answers the question. โ†ณ Are the conclusions logically supported by the data? ๐›) ๐‘๐ž๐ฉ๐ซ๐จ๐๐ฎ๐œ๐ข๐›๐ข๐ฅ๐ข๐ญ๐ฒ ๐‘๐ž๐ฏ๐ข๐ž๐ฐ๐ž๐ซ โž This reviewer answers the question. โ†ณ Is the study statistically sound and reproducible? ๐œ) ๐‹๐ข๐ฆ๐ข๐ญ๐š๐ญ๐ข๐จ๐ง๐ฌ ๐š๐ง๐ ๐‚๐จ๐ง๐ญ๐ž๐ฑ๐ญ ๐‘๐ž๐ฏ๐ข๐ž๐ฐ๐ž๐ซ โž This reviewer answers the question โ†ณ Are the limitations and context adequately discussed? Try @reviewer3com ---> reviewer3.com
2
24
2
94
4,610
Research Bites AI retweeted
Happy Halloween! What's spookier than feedback from Reviewer number 2? ๐Ÿ‘ป Today only: Upload a paper, and hear from a special surprise visitor. ๐Ÿง› Upload, if you dare...
2
4
2
17
5,390
Research Bites AI retweeted
We had a flood of uploads this weekend. Researchers everywhere are trying AI peer review for the first time. We're closing in on 10,000 uploads and celebrating with a little surprise: A free โ€œAnti Journal Journal Clubโ€ T-shirt from @Research_Bites ๐Ÿ‘• To enter: - Retweet this post - Upload your next paper Weโ€™ll draw the winner when we hit #10,000! ๐Ÿš€
1
6
17
2,467
Replying to @drmichaellevin
Weโ€™re not currently writing for readability by humans, weโ€™re writing to pass peer review. Unless peer review changes, papers will likely stay the same
1
12
773
Getting considered feedback on your papers is always difficult. Colleagues are busy, apps require paid subscriptions. ReviewThree solves both these problems. It's free app that gives you thoughtful feedback on your mauscript. Here's how to use it:
6
44
220
36,281