What the measurements say
Medical hallucination rate Baichuan AI · provider-reported 3.3% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Section 5.2.1; lower is better. Provider evaluation, not a guarantee of clinical safety.
Evaluation source (opens in a new tab)
Long-context clinical memory Baichuan AI · provider-reported 86.9score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Section 5.2.2. Evaluation score, not token capacity.
Evaluation source (opens in a new tab)
Baichuan-EBM citation precision Baichuan AI · provider-reported 90score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Section 5.3.1; retrieval evaluation on 657 expert-annotated questions.
Evaluation source (opens in a new tab)
Medical OCR unstructured similarity Baichuan AI · provider-reported 0.838score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 3, system perception tools; higher is better.
Evaluation source (opens in a new tab)
Medical OCR structured matching Baichuan AI · provider-reported 0.914score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 3, system perception tools; higher is better.
Evaluation source (opens in a new tab)
X-ray/pathology CIDEr macro-average Baichuan AI · provider-reported 0.1892score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 4, seven public benchmarks; specialist report-generation tool.
Evaluation source (opens in a new tab)
X-ray/pathology GREEN-LLM macro-average Baichuan AI · provider-reported 0.8435score Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 4, seven public benchmarks; model-judged metric.
Evaluation source (opens in a new tab)
f17k TOP-1 EXACT Baichuan AI · provider-reported 30.78% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 5, 4,893 dermatology cases and evidence-driven tool use.
Evaluation source (opens in a new tab)
f17k TOP-1 CATEGORY Baichuan AI · provider-reported 39.53% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 5, coarser category metric, not exact diagnosis.
Evaluation source (opens in a new tab)
f17k TOP-1 BLOCK Baichuan AI · provider-reported 42.71% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 5, coarser block metric, not exact diagnosis.
Evaluation source (opens in a new tab)
f17k TOP-3 Baichuan AI · provider-reported 54% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 5, multi-candidate outcome.
Evaluation source (opens in a new tab)
f17k TOP-6 Baichuan AI · provider-reported 60.68% Provider-reported M4 system evaluation in arXiv 2606.08982v1. Table 5, multi-candidate outcome.
Evaluation source (opens in a new tab) Latency and throughput depend on the host, request size, reasoning settings and load. There is no measured speed or global usage figure in this record.