Comparative analysis of convolutional neural network architectures: the efficacy of individual learning strategies and hyperparameter tuning
- 1,2 Financial University under the Government of the Russian Federation (Moscow, Russia)
Abstract
A significant gap exists between the theoretical performance of convolutional neural network (CNN) architectures and their real-world efficacy in dermatoscopic skin disease diagnosis. The primary issue is the use of universal training pipelines that disregard the internal topology of specific models, leading to suboptimal accuracy and a high risk of false-negative melanoma predictions. The goal of this work is to conduct a comparative analysis of personalized learning strategies to enhance CNN efficiency for automated diagnostics. Experimental results demonstrate that the universal approach is inferior to personalized strategies. The maximum gain in the F1-metric is achieved by adapting hyperparameters to each architecture: for EfficientNet-B1, MixUp/CutMix and Automatic Mixed Precision (AMP) were applied to improve generalization ability; DenseNet-201 was trained using the OneCycleLR policy and Random Erasing augmentation for noise robustness; Inception-ResNet-V2 utilized an increased input resolution and the CosineAnnealingLR scheduler. On a stratified subset of the ISIC-2020 dataset, a statistically significant growth in the F1-score was recorded. A key achievement was a 60.8% reduction in false-negative melanoma predictions, while the proposed methods improved precision without a substantial increase in inference time or hardware requirements. The practical significance lies in confirming that the maximum quality improvement in diagnostics is achieved through architecture-specific tuning. The results show that implementing such personalized optimization strategies is expedient for enhancing the accuracy of medical diagnostic systems.
- Received
- 03.09.2026
- Approved after review
- 16.09.2026
- Accepted
- 01.10.2026
How to cite
Беспалова Н.В., Романова Е.В. Сравнительный анализ архитектур сверточных нейронных сетей: эффективность индивидуальных стратегий обучения и гиперпараметрической настройки // Динамика сложных систем - XXI век. 2026. Т. 20. № 5. С. 56−62. DOI: https://doi.org/10.18127/j19997493-202605-08
References
- Romanova E.V., Barteva V.A., Kim S.D. Issledovanie e`ffektivnosti metodov glubokogo obucheniya v zadache klassifikacii izobrazhenij dermatoskopii. Dinamika slozhny`x sistem – XXI vek. 2026. T. 20. № 3. S. 82–90. DOI: 10.18127/j19997493-202603-09 (in Russian).
- Cheng Yu., Anikeev E.A. Thoughts on convolution kernel of convolutional neural network. Novy`e aspekty` modelirovaniya sistem i processov: Materialy` Mezhdunar. nauchno-prakt. konf. Voronezh, 26 maya 2023 g. Voronezh: Voronezhskij gosudarstvenny`j lesotexnicheskij universitet im. G.F. Morozova 2023. P. 483–491. DOI 10.58168/NAMSP_483-491. EDN VBSMQE. Zhang W. et al. Sentiment analysis in the era of large language models: A reality check. arXiv preprint arXiv:2305.15005. 2023. (in Russian).
- Bagaev I.I. Analiz ponyatij nejronnaya set` i svertochnaya nejronnaya set`, obuchenie svertochnoj nejroseti pri pomoshhi modulya TensorFlow. Matematicheskoe i programmnoe obespechenie sistem v promy`shlennoj i social`noj sferax. 2020. T. 8. № 1. S. 15–22. DOI 10.18503/2306-2053-2020-8-1-15-22 (in Russian).
- Cheng Yu., Anikeev E.A. Understanding convolutional neural networks. Novy`e aspekty` modelirovaniya sistem i processov: Materialy` Mezhdunar. nauchno-prakt. konf. Voronezh, 26 maya 2023 g. Voronezh: Voronezhskij gosudarstvenny`j lesotexnicheskij universitet im. G.F. Morozova. 2023. P. 230–236. DOI 10.58168/NAMSP_230-236 (in Russian).
- Narkevich A.N., Vinogradov K.A., Paraskevopulo K.M., Mamedov T.X. Intellektual`ny`e metody` analiza danny`x v biomedicinskix issledovaniyax: svertochny`e nejronny`e seti. E`kologiya cheloveka. 2021. № 5. S. 53–64. DOI 10.33396/1728-0869-2021-5-53-64 (in Russian).
- Chudakov G.A., Dzhunkovskij A.V. Diagnostika melanomy` putem analiza dermatoskopicheskogo izobrazheniya pri pomoshhi svertochnoj nejronnoj seti. Mezhdunarodny`j zhurnal prikladny`x i fundamental`ny`x issledovanij. 2022. № 9. S. 63–69. DOI 10.17513/mjpfi.13442 (in Russian).
- Mixajlusov A.V. Ispol`zovanie svertochny`x nejronny`x setej dlya diagnostiki raka kozhi. Vestnik Voronezhskogo gosudarstvennogo texnicheskogo universiteta. 2023. T. 19. № 1. S. 20–26. DOI 10.36622/VSTU.2023.19.1.003 (in Russian).
- Xu T., Zhou Yi., Ji K., Liang Y. When will gradient methods converge to max‐margin classifier under ReLU models. Stat. 2021. V. 10. № 1. P. 354. DOI 10.1002/sta4.354
