Radiotekhnika
Publishing house Radiotekhnika

"Publishing house Radiotekhnika":
scientific and technical literature.
Books and journals of publishing houses: IPRZHR, RS-PRESS, SCIENCE-PRESS


Тел.: +7 (495) 625-9241

 

Development of efficient fault tolerant storage and processing for multidimensional scientific data using the Hough transform

Keywords:

A.N. Kokoulin – Ph.D. (Eng.), Associate Professor, Department of Automation and Telemechanics, Perm National Research Polytechnic University. E-mail: liga_asu@mail.ru


This paper describes an approach that leverages the functionality of LH*RS – distributed data storage concept [1,2]. LH*RS is a high-availability scalable distributed data structure (SDDS). The invented LH*RS is positioned as the general-purpose method, and its efficiency does not depend on the data file type. We can analyse the way to optimize its performance characteristics, in particular for the case of imagery data. There are two main issues that appear with image files visualization and exchange: processing large images, for example high-resolution astronomy and geospatial image coverings; рrocessing requests for multiple copies of a single image with distinct scale and resolution, for example, web-site pictures having thumbnail, medium and high-resolution quality images stored separately. A new result of the paper is suggested approach to build distributed fault-tolerant storage system of imagery data. De-veloped storage schema contains the sole copy of imagery data at highest resolution and scale. Image is decomposed into data blocks of several levels. The image with the required scale and resolution is reconstructed from the corresponding set of downloaded blocks on client’s side. The developed method allows adopting the encoding and compression algorithms usage and algorithm redundancy on the block level. Thereby we can flexibly manage the redundancy, security permissions and resource consumption.
References:

 

  1. Petrov V.A. Modelirovanie perenosa i poiska dannykh v decentralizovannojj raspredelennojj sisteme, ispolzujushhejj N-k-skhemu khranenija informacii: Diss. ... kand. fiz.-mat. nauk. Mosk. fiz.-tekhn. in-t (gos. un-t). M. 2008. 112 s.
  2. Litwin W., Moussa R., Schwarz T.J.E. LH*RS: a highly available distributed data storage. URL: http://portal.acm.org/citation.cfm?id=1316816
  3. Chilingarian, I., Bartunov, O., Richter, J., Sigaev, T., PostgreSQL: the Suitable DBMS Solution for Astronomy and Astrophysics / ASP Conference Series, V. 314, Astronomical Data Analysis Software and Systems XIII. S. 225.
  4. Bartunov O.S., Samodurov V.A. Astronomija i internet: istorija vzaimootnoshenijj / Zemlja i Vselennaja. 2000. № 1. S. 49–59.
  5. Bobkov A.V. Normirovanie prostranstva priznakov pri ispolzovanii obobshhennogo preobrazovanija KHafa // Nauka i Obrazovanie. EHlektronnyjj nauchno-tekhnicheskijj zhurnal. Nauchnoe izdanie MGTU im. N.EH.Baumana. 2014. № 2.

 

© Издательство «РАДИОТЕХНИКА», 2004-2017            Тел.: (495) 625-9241                   Designed by [SWAP]Studio