350 rub
Journal Nonlinear World №11 for 2012 г.
Article in number:
Video reconstruction using background models
Authors:
V.V. Voronin, V.I. Marchuk, V.А. Frantc, N.V. Gapon
Abstract:
Currently, the decision was widespread applications processing and video analytics systems in computer vision. Most of them are done manually by the user, in connection with this is especially true solution automatically restore the video sequence, and delete objects. In the video there are static images that obscure the video, covering part of the useful information from the viewer. These images include various logos channel, date, time, or subtitles superimposed on the video signal with the further coding. In addition, the disturbing factor is the distortion power at work video codec, which is explained by the appearance of the unreliability of the data channel from the encoder to the decoder.In some cases, there may be unwanted objects on the frame sequence. An object is understood to be a connected region of pixels per frame, considered as a whole. The object can be a moving car or a person, the defect caused by a scratch on the film or the entire background scene. This paper describes a new approach to the restoration of the video, which is based on getting the model scene and tracking of moving objects. The proposed approach allows you to remove objects or restore the missing or damaged area of the video sequence using spatial and temporal information of adjacent frames. The algorithm iteratively performs the following operations: receiving a frame, update the model scene, updating the position of moving objects, the replacement of the frame with objects marked for deletion. As a possible model of the background considered moving average code book and several others. The main advantage of this approach is the ability to operate in streaming mode.
Pages: 777-781
References
  1. Сизякин Р.А., Воронин В.В., Марчук В.И., Франц В.А. Обработка видеосигналов с целью обнаружения пикселей с искаженными значениями на основе контурного анализа // Успехи современной радиоэлектроники. 2012. №6. С. 40-46.
  2. Воронин В.В. Метод реконструкции изображений на основе интерполяции границ объектов кубическими сплайнами // Успехи современной радиоэлектроники. 2012. №6. С. 26-30.
  3. Воронин В.В., Марчук В.И., Саакян Г.Р. Метод построения составной кривой при восстановлении границ объектов на изображении // Успехи современной радиоэлектроники. 2011. №9. С. 11-15.
  4. Bertalmio M., Bertozzi A.L. and Sapiro G. Navier-stokes, fluid dynamics, and image and video inpainting // Proc. IEEE CVPR. 2001. Р. 355-362.
  5. Criminisi A., Perez P., Toyama K. Region filling and object removal by exemplar-based image inpainting // IEEE Trans. ImageProcessing. 2004. №13(9). Р. 1200-1212.
  6. Марчук В.И., Воронин В.В., Франц В.А. Модифицированный метод восстановления двумерных сигналов // Научно-технические ведомости Санкт-Петербургского государственного политехнического университета. 2011. №115. С. 31-36.
  7. Марчук В.И., Воронин В.В., Шерстобитов А.И. Метод восстановления значений двумерных сигналов на основе синтеза текстуры и структуры изображений // Электротехнические и информационные комплексы и системы. 2010. Т. 6. №2. С. 25-33.
  8. Patwardhan K.A., Sapiro G., Bertalmio M. Video inpainting of occluding and occluded objects // Proc. ICIP. 2005. V. II. Р. 69-72.
  9. Jia J., Wu T.-P., Tai W.-W., Tang C.-K. Video repairing: Inference of foreground and background under severe occlusion. CVPR. 2004.
  10. Wexler Y., Shechtman E., Irani M. Space-time video completion. CVPR. 2004.
  11. Jia Yun-Tao, Hu Shi-Min , MartinRalph R.Video completion using tracking and fragment merging. 2005.
  12. Zhang Yunjun, Xiao Jiangjian, Shah Muburak. Motion Layer Based Object Removal in Videos. 2005.
  13. Bertalmio M., Sapiro G., Caselles V., Ballester C. Image inpainting // Proc. of ACM SIGGRAPH 2000. ACM.
  14. Марчук В.И., Воронин В.В. Реконструкция значений утраченных пикселей изображений в условиях ограниченной априорной информации // Научно-технические ведомости Санкт-Петербургского государственного политехнического университета. 2009. № 72. С. 52-56.