R.E. Semenov1, A.B. Sorokin2
1, 2 MIREA – Russian Technological University (Moscow, Russia)

1 9629790@gmail.com, 2 ab__sorokin@mail.ru

The aim of this study is to develop an approach for designing neural network architectures for text analysis based on the conceptual-graph method (CGM). Particular attention is given to the integration of semantic knowledge and domain-specific structures into neural models in order to enhance the accuracy, interpretability, and robustness of natural language processing systems. The proposed approach seeks to overcome the limitations of traditional neural architectures, which often operate as “black boxes” and fail to consider the deep semantic relationships between concepts. Despite their high performance, modern deep learning models suffer from several limitations, including limited interpretability, susceptibility to overfitting, and an inability to effectively capture contextual and semantic relationships inherent to specific domains. This is particularly problematic in text analysis tasks, where understanding of concept hierarchies, dependencies, and semantic context is critical. The absence of explicit knowledge representation complicates the use of such models in practical and expert systems that require transparency and domain-specific alignment.

This paper presents a methodology for employing CGM to construct semantic graphs that represent the relationships between key concepts in a text. A mechanism has been proposed for transforming these graphs into structural components of a neural architecture, thereby enhancing the model’s capacity for semantic interpretation. Examples of conceptual modeling graphs have been provided, demonstrating how semantic structures can be integrated into the training process. The benefits of CGM have been discussed, including improved predictive accuracy, reduced overfitting due to structural constraints, and enhanced robustness to noise and incomplete data. The proposed approach is valuable for developers of artificial intelligence systems operating in highly specialized domains, such as medicine, law, education, and technical expertise, where high accuracy and interpretability are essential. By formalizing expert knowledge as conceptual graphs and embedding them into the learning process, the approach enables the creation of models capable of meaningful information processing. This paves the way for hybrid intelligent systems that combine symbolic and neural methods, which is especially relevant in the context of explainable artificial intelligence (XAI) development.

Semenov R.E., Sorokin A.B. Development of neural network architecture for conceptual text analysis. Neurocomputers. 2025. V. 27. № 2. P. 23–31. DOI: https://doi.org/10.18127/j19998554-202502-03 (in Russian)

1. Obreja D.M., Rughiniș R., Rosner D. Mapping the conceptual structure of innovation in artificial intelligence research. A bibliometric analysis and systematic literature review. Journal of Innovation & Knowledge. 2024. V. 9. № 1. P. 100465 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S2444569X24000052.
2. Soori M., Arezoo B., Dastres R. Artificial intelligence, machine learning and deep learning in advanced robotics: a review. Cognitive Robotics. 2023. V. 3. P. 54–70 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S2667241323000113.
3. Martinez-Garcia A., Horrach-Rosselló P., Mulet-Forteza C. Mapping the intellectual and conceptual structure of research on CoDa in the “Social Sciences” scientific domain. A bibliometric overview. Journal of Geochemical Exploration. 2023. № 252. P. 107273 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S0375674223001206.
4. Krongauz M.A. Semantika: Uchebnik. M.: Akademiya. 2005. (in Russian)
5. Sorokin A.B., Smol'yaninova V.A. Kontseptual'noe proektirovanie ekspertnykh sistem podderzhki prinyatiya reshenij. Informatsionnye tekhnologii. 2017. T. 9. № 23. S. 634–641. (in Russian)
6. Suurmond R., Wynstra F., Vermeij A., Haag E.J. Text mining and network analytics for literature reviews: Exploring the landscape of purchasing and supply management research. Journal of Purchasing and Supply Management. 2024. V. 30. № 1. P. 100892 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S1478409223000808.
7. Dovguchits S.I. Semanticheskie osobennosti slozhnykh tekhnosotsial'nykh sistem: k voprosu o taksonomii tekhnologicheskogo paketa iskusstvennogo intellekta. Russian Technological Journal. 2023. T. 11. № 6. S. 89–98. (in Russian)
8. Rahimi S., Khatooni M. Saturation in qualitative research: An evolutionary concept analysis. International Journal of Nursing Studies Advances. 2024. V. 6. P. 100174 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S2666142X24000018.
9. Zhang X., Zhao H., Chen D.-Y. Semantic mapping methods between expert view and ontology view. Journal of Software. 2020. V. 31. № 9. P. 2855–2882.
10. Arefeen M.A., Debnath B., Chakradhar S. LeanContext: Cost-efficient domain-specific question answering using LLMs. Natural Language Processing Journal. 2024. V. 7. P. 100065 [Elektronnyj resurs]. URL: https://www.sciencedirect.com/science/article/pii/S2949719124 00013X.