2020 № 4 Moscow experiment on computer vision in radiology: involvement and participation of radiologists
B a c k g r o u n d . In 2019, the Moscow Government decided to conduct a large-scale scientific research – an the Experiment on the use of innovative computer vision technologies for medical image analysis and subsequent applicability in the healthcare system of Moscow (www.mosmed.ai).
O b j e c t i v e – analyze engagement, attitudes and feedback from doctors-radiologists in frame of the Experiment.
M a t e r i a l s a n d m e t h o d s . The Experiment is a prospective research approved by the Independent Ethics Committee and registered with Clinicaltrails.gov (ID NCT04489992). Patients signed informed voluntary consent. On the date 01.10.2020, ten services are involved in the Experiment, they providing automated analysis of chest computed tomography and x-ray, mammography. The study includes quantitative indicators of the Experiment from 06/18/2020 to 10/01/2020. Methods of social survey, descriptive statistics, assessment of diagnostic accuracy metrics were used.
R e s u l t s a n d d i s c u s s i o n . During the first four months of the active phase of the Experiment, ten computer vision services were integrate into Unified Radiology Service of Moscow. More then 497 thousand studies have been successfully analyzed. Analyzes is carried out for 884 diagnostic devices in 293 medical organizations, 272 of them are actively involved. The involvement of medical organizations is 82%. The median time for automatic analysis of 1 study is 8 minutes. Overall, 63% of studies were analyzed in less than 15 minutes. At the beginning of the Experiment, 538 doctors had access to the system; in four months this number increased to 899. The involvement of doctors was 24%, which is slightly higher than the global indicators. According to the results of a sociological survey, the attitude to AI technologies of Moscow radiologists can be characterize as expectant, moderately optimistic. Radiologists
have determined that the results of computer vision services are fully consistent with the real situation in 64% of cases. In 36% cases some inconsistencies were recorded; of this number, significant discrepancies took place in 6%, insignificant – in 23%.
C o n c l u s i o n . Results of the Experiment’s first four months can be consider as successful. A high level of involvement of radiologists is define. Special measures will be implement to increase the involvement of radiologists, as well as a comprehensive comparative assessment of the work of services at the further stages of the Experiment.
2019 № 3 Experience in developing and implementing an oncological formations searching system using artificial intelligence with the example of X‑ray computed tomography of the lungs
The experience of creating and implementing AI system Botkin.AI for identifying pulmonary nodules according to CT
data is considered. The main parameters of the model are described, the results of pilot projects of platform practical application in several regions of the Russian Federation are presented. Examples of a platform application for identifying pulmonary nodules with various size and localization are given. During pilot projects in the regions, 7 patients with high suspicion of pulmonary malignancy were identified. The results and experience show that the applying of the Botkin.AI system can be used both for the implementation of regional lung cancer screening programs and as an additional tool to increase the lung cancer detections with introducing automatic revision of chest CT data, regardless of these studies indications.