NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

ICML Review Process and Guidelines

BACKGROUND
30 SIGNALSFIRST DETECTED 8 April 2026UPDATED 20 May 2026
The NewsHive View

The crack appeared on April 8th with a question that sounds procedural until you sit with what it actually means: how are ICML 2026 reviewers submitting evaluations without completing the mandatory acknowledgement step? That acknowledgement is not bureaucratic decoration. It is the moment a reviewer formally confirms they have read the conference guidelines before sitting in judgment on someone else's year of work. Whether the cause is a platform failure or deliberate corner-cutting, the outcome is the same — researchers received evaluations from people who may not have agreed to the standards governing those evaluations. By April 14th the conversation had widened into a broader question about area chair guidance, with a community-run "qq thread" filling the vacuum left by unclear official communication. Then on April 16th something stranger surfaced: scores that had increased and then decreased, with no obvious explanation attached. A reviewer changing their mind is normal. Scores moving without explanation or visible discussion is a different thing entirely. The frustration then jumped conferences — an ECCV thread in early May documented what one poster called "stupid reviewer behavior," and by May 19th another ECCV-specific complaint had emerged about reviews showing no modification timestamps, making it impossible to tell whether a reviewer had engaged with author rebuttals at all. Two conferences, the same pattern, the same community doing the monitoring that the conferences themselves appear not to be doing publicly.

If confirmed, here is what this means. The academic publishing infrastructure that determines careers, funding, and the direction of research fields is operating with accountability gaps that the community is patching together through Reddit threads. That is not a small problem dressed in procedural language. Researchers who receive contradictory or unexplained scores have no formal mechanism to understand what happened to their submission, and area chairs operating without clear published guidance are making consequential decisions in an informal fog. The second-order effect is corrosive: when the process feels arbitrary, the most experienced researchers — the ones with options — start routing their best work elsewhere, toward workshops, preprints, or rival venues. The conferences that fail to demonstrate process integrity do not collapse immediately. They hollow out slowly, retaining the brand while losing the substance.

Watch for any official ICML or ECCV communication addressing reviewer compliance or score-change transparency — that would either confirm the community concerns or reframe them entirely. Equally telling would be silence: if neither conference acknowledges these threads, that itself becomes part of the story.

How the story developed
24 Sept
NeurIPS reject final justification [R]
OPINION · WHAT · MachineLearning
24 Sept
NeurIPS Decisions in Some Hourse to a Day [D]
OPINION · WHAT · MachineLearning
24 Sept
EACL Reviewers no response [D]
OPINION · WHAT · MachineLearning
13 Aug
Neurips 2026: Modified date on reviews [D]
OPINION · WHAT · MachineLearning
4 Aug
Do ACs also give scores? [D]
OPINION · WHAT · MachineLearning
4 Aug
3 Aug
NeurIPS 2026: Tips that might convince AC? [D]
OPINION · WHAT · MachineLearning
2 Aug
No replies to rebuttals and comments even by AC [D]
OPINION · WHAT · MachineLearning
1 Aug
Question about NeurIPS discussion phase [D]
OPINION · WHAT · MachineLearning
29 Jul
NeurIPS reviewers not engaging [D]
OPINION · WHAT · MachineLearning
17 Jul
BMVC rebuttals update [D]
OPINION · WHAT · MachineLearning
11 Jul
23 May
ICML Workshop Rejection [D]
OPINION · WHAT · MachineLearning
19 May
[ECCV 2026] No modified date next to reviews [D]
OPINION · WHAT · MachineLearning
0.0
8 May
ECCV Stupid Reviewer Behavior (Any AC here?) [R]
OPINION · WHAT · MachineLearning
0.0
16 Apr
1.6
14 Apr
3.3
Other feeds and industry voices
12 Apr
Just did an analysis on ICLR 2025 vs 2026 scores and WOW [D]

<table> <tr><td> <a href="https://www.reddit.com/r/MachineLearning/comments/1sj76a2/just_did_an_analysis_on_iclr_2025_vs_2026_scores/"> <img alt="Just did an analysis on ICLR 2025

OPINION · WHAT · MachineLearningOPEN STORY
8 Apr
ICML 2026 am I cooked? [D]

<!-- SC_OFF --><div class="md"><p>Hi, I am currently making the jump to ML from theoretical physics. I just got done with the review period, went from 4333 to 4433, but the

OPINION · WHO · MachineLearningOPEN STORY
8 Jul
First time ARR users - some questions [D]

<!-- SC_OFF --><div class="md"><p>We submitted our first paper to ARR, intending to commit to IJCNLP-AACL. Area: Multilingualism and Cross-Lingual NLP</p> <p>Scores: (3,4) (2.5,3)

OPINION · WHO · MachineLearningOPEN STORY
1 May
AI/ML Conferences [D]

<!-- SC_OFF --><div class="md"><p>As a fellow ML researcher, I feel disheartened and discouraged after seeing the experiences of people who submitted their work to ICML 2026.

OPINION · WHO · MachineLearningOPEN STORY
13 Apr
[ICML 2026] Extending the deadline for reviewer final justifications while not extending for Author-AC comments was a huge mistake [D]

<!-- SC_OFF --><div class="md"><p>Just as the title says, I believe the decision to extend the deadline for reviewers to post their final justifications while not allowing authors

OPINION · WHO · MachineLearningOPEN STORY
29 Apr
Am I crazy to think that the UAI authors are confusing the discussion deadline with the rebuttal deadline ? [D]

<!-- SC_OFF --><div class="md"><p>Hello everyone.</p> <p>UAI review results were released last Thursday, and the discussion period was clearly stated as April 23 to May 2nd.

OPINION · WHEN · MachineLearningOPEN STORY
8 Jul
ACL ARR May 2026[D]

<!-- SC_OFF --><div class="md"><p>Lets Discuss your experience in reviews in the threads (as a reviewer and an author)....also any ACs, how was the avg score this cycle in your

OPINION · HOW · MachineLearningOPEN STORY
27 Mar
[D] On conferences and page limitations

<!-- SC_OFF --><div class="md"><p>What is your opinion on long appendices in conference papers?</p> <p>I am observing that appendix lengths in conference papers (ICML, NeurIPS,

OPINION · WHAT · MachineLearningOPEN STORY
Sources
MachineLearning×30

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →