Method / evidence and interpretation

Show the work.
Keep the limits visible.

Arcophos independently analyzes MedQA and MedMCQA using the original papers, author repositories and NIST’s interval formula. Published results are historical author-reported measurements; interactive examples are labeled hypothetical.

Name the measurement

Every result identifies its split, answer format, metric and experimental setting.

Expose source conflicts

We retain the MedMCQA split-documentation discrepancy rather than silently reconcile incompatible headings.

Separate analysis from runs

Our contribution is interpretation, calculations and comparison tools. We did not run the reported model evaluations.

What this resource cannot establish

  • Examination answer accuracy does not establish clinical benefit.
  • Historical tables are not current leaderboards.
  • The interval calculator assumes a binomial model and does not test a paired model difference.

Original analysis and reported evidence

We distinguish source facts from our interpretations. Benchmark creators are credited in each dossier. Reproduced result rows are selected historical measurements from an identified paper version and configuration. They are not new Arcophos runs, a complete leaderboard, or a claim about the latest models.

When papers, repositories, or releases disagree, the dossier records which source governs the displayed claim. The evidence JSON exposes these facts, source IDs, and version notes for inspection. Dataset access and licensing are reported separately.

Analytical tools

Coverage explorers organize published task categories with our annotations; the number of displayed entries is not a performance score. Calculator inputs are explicitly illustrative. Published scoring formulas are applied to those inputs, while sampling assumptions and aggregation boundaries remain visible. These tools cannot establish clinical efficacy.

Using the worksheet

The worksheet turns the editorial guidance into a planning brief. Its completion count records items you have addressed. It does not estimate model quality, validate safety, or certify a system. The exported file includes selected and unresolved items so the remaining work stays visible.

Corrections and updates

When a source or interpretation changes, the affected guide and its update date should change together. Send the page URL, the disputed statement, and a primary reference through Arcophos contact.