217: AI vs. Pathologist: Validating Ki-67 Assessment in Pulmonary Neuroendocrine Neoplasms

Send us Fan Mail

Paper Discussed in this Episode:

Ki-67 Proliferation Index in Pulmonary Neuroendocrine Neoplasms: Interobserver Agreement Among Pathologists and Comparison of Two Artificial Intelligence-Based Image Analysis Systems. Teoman G, Turkmen Usta Z, Sagnak Yilmaz Z, Ersoz S. MDPI 2026.

Episode Summary:

In this journal club deep dive, we step into the lab to examine a direct comparison between expert human pathologists and artificial intelligence. We explore a 2026 study that evaluates how two different AI image analysis systems score the critical Ki-67 biomarker in Pulmonary Neuroendocrine Neoplasms (PNENs) alongside four experienced human experts. Unlike stories where AI and humans clash, this study explores a different exciting reality: Can AI perfectly match the human gold standard to automate and standardize a highly tedious, labor-intensive medical process?

In This Episode, We Cover:

• The Diagnostic Challenge of Lung NENs: Understanding Pulmonary Neuroendocrine Neoplasms, a biologically diverse group of lung tumors ranging from slow-growing typical carcinoids to highly aggressive large cell neuroendocrine carcinomas. We discuss why precise classification is critical for predicting patient outcomes and guiding treatment.

• The Spotlight Biomarker (The Speedometer): ◦ Ki-67: The definitive marker of active cellular proliferation, essentially acting as the tumor's "speedometer". While not formally incorporated into the WHO grading criteria for lung NENs, it is a vital clinical tool used to distinguish low-grade from high-grade tumors and identify biologically aggressive lesions.

• The Showdown - Humans vs. AI: Four experienced pathologists go head-to-head with two digital heavyweights—the Roche uPath Ki-67 and the Virasoft Virasight Ki-67 algorithms. They analyzed 63 cases across different tumor subtypes, meticulously evaluating approximately 2,000 cells per predefined tumor hotspot.

• Round 1 - Impressive Human Concordance: The human experts achieved near-perfect interobserver agreement (an Intraclass Correlation Coefficient of 0.998) when utilizing pre-selected hotspot regions, proving that standardized manual counting by experts is highly reliable.

• Round 2 - AI Meets the Gold Standard: Both AI systems demonstrated massive, statistically significant correlations with the human experts' assessments. The AI reliably stratified the lung tumors into low, intermediate, and high-risk clinical categories without systematic bias, proving the algorithms can match human accuracy.

• The Future of the Lab: Why AI shouldn't replace pathologists, but rather serve as a reproducible, objective assistant in the pathology lab. We discuss how automated AI analysis can reduce observer fatigue, enable rapid assessment of large tumor areas, and standardize testing across institutions, despite current roadblocks like algorithm complexity and a lack of wide accessibility.

Key Takeaway:

Artificial intelligence doesn't have to disagree with humans to prove its profound clinical worth. By successfully matching the excellent accuracy of top pathologists, these AI systems proved they can reliably handle the exhausting, subjective task of tumor cell counting. This paves the way for faster, highly standardized tumor evaluation, which could ultimately lead to more consistent and reliable prognostic diagnoses for lung cancer patients

Support the show

Get the "Digital Pathology 101" FREE E-book and join us!