NewsHive
CONTACT USANALYST PORTAL →
aiBACKGROUND

Asking Is Not Enough: Protocol Sensitivity in LLM Confidence Calibration

BACKGROUND
1 SIGNALFIRST DETECTED 28 May 2026
Narrative synthesis pending — 1 signal collected.
How the story developed
Other feeds and industry voices
16 Apr
Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models

arXiv:2604.13206v1 Announce Type: new Abstract: As Large Language Models (LLMs) are increasingly integrated into agentic workflows, their unpredictability stemming from numerical

REPORT · WHAT · ArXiv CS.AIOPEN STORY
17 Aug
Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors

arXiv:2608.13591v1 Announce Type: new Abstract: High-confidence errors in large language models are often treated as evidence of fragile internal inference. We study a different

REPORT · WHERE · ArXiv CS.AIOPEN STORY
2 Oct
Beyond Answer Confidence: A Controlled Audit of Self-Knowledge in a Black-Box Decision Model

arXiv:2610.01006v1 Announce Type: new Abstract: Decision models return probabilities intended for routing, abstention and automated action. Calibration makes those probabilities

REPORT · WHEN · ArXiv CS.AIOPEN STORY
1 Apr
Structured Intent as a Protocol-Like Communication Layer: Cross-Model Robustness, Framework Comparison, and the Weak-Model Compensation Effect

arXiv:2603.29953v1 Announce Type: new Abstract: How reliably can structured intent representations preserve user goals across different AI models, languages, and prompting

REPORT · HOW · ArXiv CS.AIOPEN STORY
14 Jul
Format Sensitivity Index: Token-Controlled Prompt Wrapper Robustness and Schema Compliance in LLM Benchmarking

arXiv:2607.09665v1 Announce Type: new Abstract: Prompt wrappers often differ only in formatting, yet they can change model scores enough to flip leaderboard conclusions. We study

REPORT · WHAT · ArXiv CS.AIOPEN STORY
6 Oct
Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities

arXiv:2610.03894v1 Announce Type: new Abstract: A deployed LLM agent emits tool calls, queries, and code that can be silently wrong -- by the time the error surfaces, the action

REPORT · WHAT · ArXiv CS.AIOPEN STORY
13 Aug
When Self-Consistency Backfires: Majority Vote Hurts the Majority of Hard Science Problems for Small LLMs

arXiv:2608.11403v1 Announce Type: new Abstract: Self-consistency (SC) via majority vote is a widely used way to spend inference-time compute: sample N chains of thought, return

REPORT · WHEN · ArXiv CS.AIOPEN STORY
27 Aug
Benchmarking LLM Judges for Voice-Agent Evaluation: Reliability, Calibration, and Human Oversight

arXiv:2608.24314v1 Announce Type: new Abstract: Evaluating conversational voice agents at scale re- quires reliable assessment methods that capture both observ- able interaction

REPORT · WHAT · ArXiv CS.AIOPEN STORY
Sources
ArXiv CS.AI

NewsHive monitors these sources continuously. All signal titles above link to the original reporting.

Intelligence by NewsHive. Need help navigating what this means for your business? Contact GeekyBee →