Paper preview for Proper Scoring Rules for Agentic Uncertainty Quantification
paper-1.png / paper-1.jpg

Preprint · ICML '26 CTB · FAGEN

Proper Scoring Rules for Agentic Uncertainty Quantification

S. Raghu*, S. Pandey*, S. Pandey

A family of strictly proper trajectory-level scoring rules for evaluating uncertainty in LM agents, including a censored-trace extension and negative results for common calibration metrics.

Paper preview for SELFDOUBT
paper-2.png / paper-2.jpg

Preprint · ICML '26 FAGEN

SELFDOUBT: Uncertainty Quantification for Reasoning LLMs via the Hedge-to-Verify Ratio

S. Pandey*, S. Raghu*, S. Pandey

A black-box uncertainty framework that extracts hedge and verify signals from reasoning traces, improving discrimination at lower inference cost.

Paper preview for Don't Blink
paper-3.png / paper-3.jpg

Preprint · Under Review

Don't Blink: Evidence Collapse during Multimodal Reasoning

S. Raghu*, S. Pandey*

An analysis of evidence collapse in reasoning VLMs, showing how visual grounding can decay during generation even when model confidence remains high.

Paper preview for Repair of Thought
paper-4.png / paper-4.jpg

Under Review · JSS

Repair of Thought: Advancing Automated Program Repair through a Dual-Model Reasoning Framework

S. Pandey, et al.

A function-level automated program repair framework combining dual-model reasoning with verification through AST alignment, control-flow symbolic analysis, and semantic checks.