Benchmark dossiers / independent analysis

The benchmark behind the number.

Inspect what each benchmark asks, how its score is produced, and which conclusions its design can support. These are original analyses by Arcophos of the benchmark authors’ work. Any reproduced measurements are labeled with their published source and version.

Dossier01

Original 2020 paper; USMLE four-option evaluation

MedQA · USMLE four-option ↗

A medical answer-selection score with a specific denominator.

UnitQuestionMeasureAnswer-selection accuracy
Dossier02

CHIL 2022 paper; exact split counts from §3/Table 2

MedMCQA ↗

The split and the retrieval source belong beside the score.

UnitQuestionMeasureAnswer-selection accuracy
What we contribute. Source reconciliation, task and metric interpretation, and tools that make assumptions inspectable. We do not claim to have created these benchmarks or run the reported models.