D.S. Kumankin1, S.A. Yamashkin2, S.A. Fedosin3

1–3 National Research Mordovian State University n.a. N.P. Ogarev (Saransk, Russia)
1 d.kumankin@gmail.com; 2 yamashkinsa@mail.ru; 3 fedosinsa@mrsu.ru

Geographically referencing satellite images plays a key role in geospatial data processing, as the accuracy of referencing directly affects the quality of subsequent data analysis and interpretation. Traditional geo-referencing methods, such as manual annotation using datum points or the use of descriptor algorithms (SIFT, SURF, ORB), have certain disadvantages. These methods are time-consuming and labor-intensive, especially when dealing with large amounts of data, and often depend on the human factor, which can lead to subjective errors. Often, existing geo-referencing methods do not take into account complex non-linear relationships that arise in conditions of changing illumination, shooting angles and seasonal changes in the landscape. Ignoring these non-linear factors can lead to significant distortion in the binding process, reducing the overall accuracy of data processing. It is necessary to develop a method of geo-referencing satellite images that would combine high accuracy, speed and resistance to changing shooting conditions, taking into account possible non-linear dependencies, to increase the efficiency of processing geospatial data in real conditions.

Purpose – develop a method to refine the geographic mapping of satellite images based on Siamese neural networks.

It has been established that the use of Siamese neural networks for the task of geo-referencing satellite images demonstrates accuracy comparable to descriptor methods, while significantly exceeding them in processing speed. It was found that the average time for processing one image was 0.112 s. It was noted that the best binding accuracy was achieved at a resolution of 10 m per pixel, where the average absolute error (MAE) was 18.3 m in the autumn. At higher resolutions, the accuracy decreased, but the method still showed stable results even at a resolution of 50 m per pixel. It has been shown that the proposed method using Siamese neural networks is able to take into account and adapt to non-linear processes, such as the variability of illumination and relief, which makes it more resistant to changes in shooting conditions compared to traditional algorithms.

The proposed method makes it possible to significantly speed up the process of geo-referencing, which is especially important when processing large amounts of data in automatic mode. This opens up the possibility of using the method in monitoring and mapping tasks, where high accuracy is required with minimal time spent. The application of Siamese nets can reduce processing time and improve accuracy in complex landscapes such as forests and meadow areas, with practical implications for ecology, agriculture and area management.

1. How Do I Use Ground Control Points? [Электронный ресурс]. URL: https://www.dronedeploy.com/blog/what-are-ground-control-points-gcps (дата обращения: 15.09.2024).
2. Otero I.R. Anatomy of the SIFT method: phdthesis. École normale supérieure de Cachan. ENS Cachan, 2015.
3. Bay H., Ess A., Tuytelaars T., Van Gool L. Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding. 2008. V. 110. № 3. P. 346–359.
4. Rublee E., Rabaud V., Konolige K., Bradski G. ORB: An efficient alternative to SIFT or SURF. 2011 International Conference on Computer Vision. 2011. P. 2564–2571.
5. Dey S., Dutta A., Saha S., Ghosh S. Signet: Convolutional Siamese Network for Writer Independent Offline Signature Verification: arXiv:1707.02131. arXiv, 2017.
6. Douze M., Johnson J., Jégou H. The Faiss library: arXiv:2401.08281. arXiv, 2024.
7. Neubeck A., Van Gool L. Efficient Non-Maximum Suppression. 18th International Conference on Pattern Recognition (ICPR’06). 2006. V. 3. P. 850–855.
8. Hosang J., Benenson R., Schiele B. Learning Non-Maximum Suppression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017. P. 4507–4515.
9. Kuman'kin D.S., Yamashkin S.A. Arhitekturnye principy postroeniya konvejerov mashinnogo obucheniya dlya resheniya zadachi upravleniya processom analiza dannyh distancionnogo zondirovaniya Zemli. Nelinejnyj mir. 2023. T. 21. № 3. S. 27–37 (In Russian).