As of now, the evaluation of bone marrow smears by medical experts, cytomorphology, is the gold-standard in diagnosing hematologic malignancies. The way cytomorphology is performed remained unchanged and unchallenged for the last 50+ years.
Despite its central role in the diagnostic workflow, the overall procedure is still susceptible to error. First and foremost, the evaluation of cells under the microscope is highly subjective and by no means standardized. Hence, diagnostic accuracy relies solely on the vigilant eye of the observer. Further, expert knowledge is hard to come by and it takes years to master the accurate distinction of subtle nuances present in malignant disease. What’s more, the process itself – differentiating cells, counting individual cell types, forming ratios – is entirely done by hand and thus, takes hours to days until a final report is ready.
Therefore, we have developed a software prototype utilizing computer vision to automatically provide diagnosis from bone marrow smears. We trained our prototype on > 2000 samples of bone marrow smears from multiple centers in order to provide robust and generalizable models. So far, it accurately distinguishes between acute myeloid leukemia, acute promyelocytic leukemia, myelodysplastic syndromes and healthy controls.
Instead of tedious manual manual labour, our prototype provides a diagnosis within less than a minute with accuracies >95%. Further, our pipeline uses weakly supervised learning to identify digital biomarkers as well as molecular alterations based on visual information only.
We are currently working on expanding our portfolio with regard to other hematological entities and biomarkers as well gathering data from large cohorts with diverse treatment regimens. To this end, we collaborate with colleagues from Mount Sinai Hospital (New York), University of Chicago, and University of Colorado Denver.