TypedBench: A Benchmark for Calibration, Framing Sensitivity, and Cost in System One Decision Models
arXiv:2610.11392v2 Announce Type: replace Abstract: System One models output calibrated probabilities over typed answers such as categorical choices, ordinal levels, or binary outcomes, via a non-generative interface. Software can act on these probabilities through thresholds, cost-weighted choices, and escalation rules. Consequently, if these probabilities are miscalibrated or wording-sensitive, the software ma take unintended actions leaving human operators with no textual rationale to inspec…