Health BenchmarkBenchmark analysis
How HealthBench scoring works, step by step
Follow signed rubric points, positive-point denominators and aggregate clipping without confusing the result with accuracy.
Original analysis / Health Benchmark
Read the benchmark closely.
Original HealthBench evaluates open-ended health conversations with physician-written criteria. Its score combines rewarded behavior, penalties and a conversation-level denominator. This publication makes that measurement inspectable through sourced benchmark facts, a coverage breakdown and an abstract rubric calculator. The guides explain what a score means, how its units differ, and where grader validation applies. Arcophos provides independent analysis; OpenAI and its research collaborators created HealthBench.
5 min read
Benchmark analysis
Seven themes, five axes: two different HealthBench denominators
Read conversation coverage and rubric composition without treating criteria as patients or repeated assignments as unique items.
Benchmark analysis
What HealthBench grader validation does and does not establish
Separate agreement with physicians, repeated-run variability and the clinical claims that neither measurement directly tests.