S.V. Vasilyev1, A.V. Bogoslovsky2, I.V. Zhigulina3

1,2 MESC AF “N.E. Zhukovsky and Y.A. Gagarin Air Force Academy” (Voronezh, Russia)

1 stanislav-vas1986@mail.ru; 2 p-digim@mail.ru; 3 ira_zhigulina@mail.ru

To improve the methods of spatio-temporal filtering, an approach based on the analysis of finitary images energy spectra can be used. The purpose of this work is to study the possibility of using energy spectra for motion identification in video sequence frames.

Each frame of a video sequence is a spatially finite image, the energy spectrum of which contains information about the phase components. This information is of particular importance for determining the location of dynamic objects. The most important information is also contained in the harmonic amplitude increments of the frame energy spectra, i.e. the energy spectrum generates a scalar discrete field. The energy functions describe inter-frame changes in the amplitudes of harmonics of the energy spectrum. To apply energy spectra in motion identification algorithms, it is necessary to analyze the properties of these scalar fields.

Scalar fields generated by energy spectra of frames of test video sequences are studied. Test video sequences with an object moving in an arbitrary direction are used. Scalar fields of energy functions are presented graphically. Characteristic regions of scalar fields are identified and their projections are built using isolines. The boundaries of the characteristic areas and the coordinates of extrema of energy functions are determined. From them, all coordinates of the dynamic object and its horizontal/vertical displacements can be found.

The dependence of phase-energy function extrema on the position of the object before the motion and on the direction of motion is studied. When moving in an arbitrary direction, different types of extrema are observed: point and extended. At vertical or horizontal movements, the energy functions graphs have only two-dimensional pulses.

Additional criteria for eliminating ambiguities are proposed. The ambiguities are due to the fact that the number and nature of extrema may coincide for different directions of motion and location of objects in different quadrants of the coordinate plane.

The extrema of energy functions for object movements in all possible directions and locations in any quadrant of a video sequence frame are determined. The obtained results showed that energy functions for object motion in arbitrary direction have a large number of characteristic regions containing point and extended extrema. The configuration of extrema depends both on the direction of motion and on the quadrant of the image in which the object is located. Therefore, it is most advisable to begin to determine the spatial coordinates of an object and the magnitude of its horizontal/vertical movement by finding the maximum and minimum boundaries of energy functions, and then refine it using the coordinates of the extrema.

Consideration of characteristic regions and extrema of scalar fields of energy functions can be used in the development of algorithms effective in terms of "accuracy/speed" ratio, and can increase the performance of image and video processing systems.

Algorithms for determining the object position, velocity and direction of its movement by analyzing scalar fields of energy spectra components can be used as an additional or main tool for motion identification in technical vision systems.

Vasilyev S.V., Bogoslovsky A.V., Zhigulina I.V. Scalar fields features of video sequences energy characteristics. Radiotekhnika. 2024. V. 88. № 2. P.86−97. DOI: https://doi.org/10.18127/j00338486-202402-12 (In Russian)

1. Djevis R., Tverk M. Komp'ternoe zrenie. Sovremennye metody i perspektivy razvitija. M.: DMK Press. 2022. 690 s. (in Russian).
2. Mareev A.V., Orlov A.A., Ryzhkova M.N. Metody lokalizacii ob#ektov v videopotoke. Radiotehnicheskie i telekommunikacionnye sistemy. 2021. № 3. S. 48-60. (in Russian).
3. Luk'janica A.A., Shishkin A.G. Cifrovaja obrabotka videoizobrazhenij. M.: Aj-Jes-Jes Press. 2009. 511 s. (in Russian).
4. Alpatov B.A., Babajan P.V., Ershov M.D. Podhody k obnaruzheniju i ocenke parametrov dvizhushhihsja ob’ektov na video-posledovatel'nosti primenitel'no k transportnoj analitike. Komp'juternaja optika. 2020. № 5. S. 746-756. (in Russian).
5. Katulev A.N., Hramichev A.L., Jagol'nikov S.V. Cifrovaja obrabotka 2D slabokontrastnyh izobrazhenij, formiruemyh optiko-jelektronnym priborom v slozhnyh fonovyh uslovijah. Obnaruzhenie, raspoznavanie, soprovozhdenie dinamicheskih ob’ektov. M.: Radiotehnika. 2018. 408 s. (in Russian).
6. Favorskaja M.N., Pahirka A.I., Shilov A.S., Damov M.V. Metody poiska dvizhenija v videoposledovatel'nostjah. Vestnik Sibirskogo gos. ajerokosmicheskogo un-ta im. akad. M.F. Reshetneva. 2009. № 1-2. S. 69-73. (in Russian).
7. Dvorkovich V.P., Dvorkovich A.V. Cifrovye videoinformacionnye sistemy (teorija i praktika). M.: Tehnosfera. 2012. 1008 s. (in Russian).
8. Bogoslovskij A.V. i dr. Obrabotka mnogomernyh signalov. V 2-h knigah. Kn. 1. Linejnaja mnogomernaja diskretnaja obrabotka signalov. Metody analiza i sinteza: Monografija. Pod red. A.V. Bogoslovskogo. M.: Radiotehnika. 2013. 168 s. (in Russian).
9. Bogoslovsky A., Zhigulina I. A way of energy analysis for image and video sequence processing. Eds. M.N. Favorskaya, L.C. Jain. Computer vision in control systems-1. ISRL. V. 73. P. 183−210. Springer. Switzerland. 2015.
10. Zhigulina I.V. Soderzhit li jenergeticheskij spektr izobrazhenija informacii o fazovyh sostavljajushhih? Radiotehnika. 2017. № 12. S. 8-12 (in Russian).
11. Bogoslovsky A., Zhigulina I., Maslov I., Mordovina T. Frequency Characteristics for Video Sequences Processing. Smart Innovation, Systems and Technologies. V. 40: Intelligent Interactive Multimedia Systems and Services. P. 149−160. Springer. Switzerland. 2015.
12. Ponomarev A.V., Bogoslovskij A.V., Zhigulina I.V., Suharev V.A. Osobennosti korreljacionnogo analiza izobrazhenij i videoposledovatel'nostej. Zhurnal SFU. Tehnika i tehnologii. 2018. №11/7. S. 811-822 (in Russian).