G.S. Lebedev1, E.N. Fartushniy2, O.A. Novikova3, I.V. Fomina4

1-3 I.M. Sechenov First Moscow State Medical University (Moscow, Russia)

1,4 Federal Research Institute for Health Organization and Informatics (Moscow, Russia)

1lebedev_g_s@staff.sechenov.ru, 2fartushniy_e_n@staff.sechenov.ru, 3novikova_o_a@staff.sechenov.ru, 4fomina@inbox.ru

The NTI Foundation holds a series of UpGreid competitions to support breakthrough technologies in the Russian Federation. In the field of AI, these are two competitions: AI`M Doctor and AI`M Finder. The essence of the competitions is to determine the best solution in the field of medical AI, which allows for an accurate diagnosis. The Center for Digital Medicine of Sechenov University, being a partner of the competition, has developed a method for holding these competitions, which includes a mathematical apparatus for assessing the achievements of each solution, a mathematical apparatus for comparing solutions, a methodology for forming data sets for training and holding competitions. This article describes the method and discusses the possibility of its use for the development of AI in medicine.

Lebedev G.S., Fartushniy E.N., Novikova O.A., Fomina I.V. Method of conducting competitions of artificial intelligence systems in medicine. Information-measuring and Control Systems. 2024. V. 22. № 5. P. 97−104. DOI: https://doi.org/10.18127/j20700814-202405-11 (in Russian)

1. Tekhnologicheskii konkurs Fonda NTI AI`M Doctor https://ai4med.upgreat.one. (in Russian)
2. Tsentr tsifrovoi meditsiny Sechenovskogo Universiteta https://www.sechenov.ru/univers/structure/nauchno-tekhnologicheskiy-park-biomeditsiny/institut-biodizayna-i-modelirovaniya-slozhnykh-sistem/tsentr-tsifrovoy-meditsiny/. (in Russian)
3. Federalnyi zakon ot 21.11.2011 g. № 326-FZ "Ob osnovakh okhrany zdorovya grazhdan v Rossiiskoi Federatsii". (in Russian)
4. Postanovlenie Pravitelstva Rossiiskoi Federatsii ot 27.12.2012 g. № 1416 "Ob utverzhdenii pravil registratsii meditsinskikh izdelii". (in Russian)
5. Soglashenie o edinykh printsipakh i pravilakh obrashcheniya meditsinskikh izdelii (izdelii meditsinskogo naznacheniya i meditsinskoi tekhniki) v ramkakh Evraziiskogo ekonomicheskogo soyuza ot 23.12.2014 g. (in Russian)
6. Reshenie Soveta Evraziiskoi ekonomicheskoi komissii ot 12.02.2016 g. № 29 "O pravilakh provedeniya klinicheskikh i kliniko-laboratornykh ispytanii (issledovanii) meditsinskikh izdelii". (in Russian)
7. Prikaz Minzdrava Rossii ot 30.08.2021 g. № 885N "Ob utverzhdenii "Poryadka provedeniya otsenki sootvetstviya meditsinskikh izdelii v forme tekhnicheskikh ispytanii, toksikologicheskikh issledovanii, klinicheskikh ispytanii v tselyakh gosudarstvennoi registratsii meditsinskikh izdelii". (in Russian)
8. Prikaz Minzdrava Rossii ot 06.06.2012 g. № 4n "Ob utverzhdenii nomenklaturnoi klassifikatsii meditsinskikh izdelii". (in Russian)
9. GOST R ISO 14155-2014 "Klinicheskie issledovaniya. Nadlezhashchaya klinicheskaya praktika". (Prikaz Federalnogo agentstva po tekhnicheskomu regulirovaniyu i metrologii ot 4 iyunya 2014 g. № 497-st). (in Russian)
10. GOST R 59921.1-2022. Sistemy iskusstvennogo intellekta v klinicheskoi meditsine. Chast 1. Klinicheskaya otsenka. (in Russian)
11. GOST R 59921.5-2022. Sistemy iskusstvennogo intellekta v klinicheskoi meditsine. Chast 5. Trebovaniya k strukture i poryadku primeneniya nabora dannykh dlya obucheniya i testirovaniya algoritmov. (in Russian)