350 rub
Journal Biomedical Radioelectronics №9 for 2013 г.
Article in number:
The mathematical information theory for using in biology and medicine
Keywords:
information theory
biology
medicine
the theory of signals
the signal/noise ratio
the optimal resolution
entropy
specific information content
the metrological information
capacity
telecommunications channel
multi-position modulation methods
Authors:
G.I. Khudiakov - technical science doctor, professor of the medical radioelectronics department of Saint-Petersburg state university of aerospace instrumentation. E-mail: khudgi@mail.ru
Abstract:
The paper presents the main results of theoretical investigations in the field of clarification of the information theory-s basic notions which were carried out by the author during the last five years.
In the field of statistical signal theory: there have been refined the signal/noise ratio (required for power: Q = s2/σп2 - because it provides additively quantities Q), the sampling theorem for stationary random signals, and also the problem of optimal resolution of two Gaussian signals in Gaussian noise was solved.
In the field of applied information theory. The formula for the amount of information I(wk| uj), contained in the output symbol wk, about information contained in the input sign uj - if the interferences are in a transmission channel of information, which is determined by equality I(wk| uj) = log [P(wk| uj)/P(wk)], qualifies as the fifth postulate of Shannon's information theory, that results in all the laws of information transmitting over a noisy communication channels. Shannon formally introduced the notion of "entropy of source of discrete messages" is interpreted as the specific informatively of the source, which has the dimension [bit/sign]. Clarified the condition of a complete loss of information in binary communication channels with interference: p + q = 1, where p is the probability of the output channel "unit" subject to the submission to the input channel "unit", and q - the probability of "zero" in the filing "zero." Condition of the absolute reliability binary channel is not only p + q = 2, but p + q = 0. It was also found that in the case of the so-called "continuous messages" as a measure of the quantity of metrological information should be no differential (relative, reduced) entropy of measurement errors but the inverse dispersion of these errors (which satisfies all the postulates of the theory of information, including the postulate of additively), then there is R. Fisher-s information measure.
In the mathematical theory of information: there was offered a simple digital method, which allows you to estimate not only the capacity of the communication channel, but also the optimal number of signal levels. This method allowed us to determine the capacity of a communication channel with additive white Gaussian noise with limited peak power for example, which (capacity) can not be evaluated analytically, and to evaluate the information characteristics of modern telecommunication links with various digital modulation techniques.
Pages: 63-69
References
- Polyakov A.O. Vvedenie v osnovy' informaczionnoj medicziny': ucheb. posobie. SPb.: Izd-vo SPbGPU. 2005. 150s.
- Shennon K. Matematicheskaya teoriya svyazi. Raboty' o teorii informaczii i kibernetike / per. s angl. pod red. R.L. Dobrushina i O.B. Lupanova. M.: Izd-vo IL. 1963. S. 243-332.
- Zajchenko K.V. i dr. Ot strunnogo gal'vanometra do e'lektrokardiografii sverxvy'sokogo razresheniya // Biomediczinskaya radioe'lektronika. 2010. № 9. S. 62-78.
- Xudyakov G.I. Statisticheskaya teoriya radiotexnicheskix sistem. M.: Izd. czentr «Akademiya». 2009. 400 s.
- Zajchenko K.V., Gurevich B.S. Mnogospektral'naya obrabotka izobrazhenij biologicheskix ob''ektov s pomoshh'yu akustoopticheskix ustrojstv // Nastoyashhij sbornik.
- Xudyakov G.I. Prikladnaya teoriya informaczii. Informaczionnaya teoriya radiotexnicheskix sistem: ucheb. posobie. SPb: Izd-vo SZTU. 2011. 297 s.
- Pirs Dzh. Simvoly', signaly', shumy'. Zakonomernosti i proczessy' peredachi informaczii. M.: Mir. 1967. 335 s.
- Xudyakov G.I., Osipov A.D. Razvitie teorii oczenivaniya propusknoj sposobnosti sistem e'lektro- i radiosvyazi // Komponenty' i texnologii. 2011. № 7. S. 147-154.
- Xudyakov G.I. Propusknaya sposobnost' czifrovy'x kanalov e'lektrosvyazi s kvadraturnoj amplitudnoj modulyacziej // E'lektrosvyaz'. 2010. № 6. S. 11-13.
- Xudyakov G.I. O propusknoj sposobnosti sovremenny'x czifrovy'x kanalov e'lektrosvyazi // Komponenty' i texnologii. 2011. № 3. S. 116-117.
- Xudyakov G.I. Oczenka propusknoj sposobnosti kanalov aviaczionnoj czifrovoj e'lektrosvyazi // E'lektrosvyaz'. 2009. № 5. S. 37-38.