Proper Scoring Rules for Agentic Uncertainty Quantification
A family of strictly proper trajectory-level scoring rules for evaluating uncertainty in LM agents, including a censored-trace extension and negative results for common calibration metrics.
Publications
A family of strictly proper trajectory-level scoring rules for evaluating uncertainty in LM agents, including a censored-trace extension and negative results for common calibration metrics.
A function-level automated program repair framework combining dual-model reasoning with verification through AST alignment, control-flow symbolic analysis, and semantic checks.