350 rub
Journal Neurocomputers №9 for 2013 г.
Article in number:
The approaches and methods of radial basis functions networks learning to solve mathematical physic problems
Authors:
V.I. Gorbachenko - Professor, Head of Chair «Computer technology», Penza State University. E-mail: gorvi@mail.ru M.V. Zhukov - Post-graduate Student, Penza State University. E-mail: maxim.zh@gmail.com
Abstract:
One of the most effective numerical methods of mathematical physics problems solving is a meshfree method, based on radial basis function networks (RBFNs). The main difficulty, related with it, is parameters and weights of radial basis functions (RBFs) definition. The purpose of this article is to explore RBFN parameters configuration approaches and their realization methods. There are two parameters configuration approaches: Adjust RBFs weights only and set special fixed values for the others RBFs parameters. Adjust all RBFs parameters. There are peculiarities of use of both approaches to solve linear, non-linear and non-stationary partial difference equations were examined; three methods of the former approach realization and five methods of the latter approach realization were considered in this article. So, when the former approach is used, the task of network learning reduces to a linear least squares problem. Its solution is found as the solution of an overdetermined system of linear equations. QR or SVD decomposition can be used to solve it or it can be converted to a normal system of linear equations. Moreover, to preserve linearity of the least squares problem quasi-linearization should be used. The network learning reduces to a quadratic functional minimization problem when the latter approach is used. Among the methods of this approach realization hybrid method, fast c cubic algorithm, Fast Cubic Algorithm, dense clouds method, trust region method and Levenberg-Marquardt were examined. To demonstrate how both approaches are practiced and to compare them and their methods of realization with one another two differential equations were solved: Poisson equation and semilinear elliptic equation with a first-type boundary condition and a third-type boundary condition accordingly. According to the exploration, the conclusion was made in the last part of the article: the former approach, realized with SVD decomposition, makes it possible to solve linear difference equations effectively, moreover, this approach can be used to solve nonlinear equations. The quasilinearization is required in such case, but it makes worse the qualitative characteristic of the approach sharply. The main difficulties, related with this approach, are optimal values selection of widths and RBFs - amount, quasilinearization need. The latter approach is more commonly and can solve linear equations as well as nonlinear. From the point of view of effectiveness, according to the experiments result again, it is inferior to the former to a very little degree when it is used to solve linear equations and excels it in nonlinear equations solving. Among examined its realization methods, trust region is best. The main difficulty, related with it, is finding an initial approximation.
Pages: 12-18
References

  1. Xajkin S. Nejronny'e seti: polny'j kurs. M.: Vil'yams. 2006.
  2. Gorbachenko V.I., Artyuxina E.V., Artyuxin V.V. Radial'no-bazisny'e nejronny'e seti dlya resheniya kraevy'x zadach bessetochny'mi metodami // Sbornik nauchny'x trudov XII Vseross. nauchno-texnich. konf. «Nejroinformatika( 2010». V 2-x chastyax. 2010. Ch. 2. S. 237-247.
  3. Vasil'ev A.N., Tarxov D.A. Nejrosetevoe modelirovanie: Princzipy'. Algoritmy'. Prilozheniya. SPb.: Izdatel'stvo Politexnicheskogo universiteta. 2009. 
  4. Kansa E.J. Multiquadrics ( a scattered data approximation scheme with applications to computational fluid-dynamics. I. Surface approximations and partial derivatives // Computers & Mathematics with Application. 1990. V. 19(8). P. 127-145.
  5. Uotkins D. Osnovy' matrichny'x vy'chislenij. M.: Binom. 2012.
  6. Hardy R.L. Multiquadric equations of topography and other irregular surfaces // Journal of Geophysical Research. 1971. V. 76(8). P. 1905-1915.
  7. Franke R. Scattered data interpolation: tests of some methods // Mathematics of Computation. 1982. V. 38(157). P. 181-200.
  8. Rippa S. An algorithm for selecting a good value for the parameter c in radial basis function interpolation // Advances in Computational Mathematics. 1999. V. 11(2-3). P. 193-210.
  9. Jianyu L., Siwei L., Yingjiana Q., Yapinga H. Numerical solution of elliptic partial differential equation using radial basis function neural networks // Neural Networks. 2003. V. 16(5-6). P. 729-734.
  10. Peng H., Ozaki T., Haggan-Ozaki V., Toyoda Y. A Parameter Optimization Method for Radial Basis Function Type Models // IEEE Transactions on Neural Networks. 2003. V. 14(2). P. 432-438.
  11. Galperin E. A., Zheng Q. Solution and control of PDE via global optimization methods // Computers & Mathematics with Applications. 1993. V. 25(10-11). P. 103-118.
  12. Conn A.R., Gould N.M., Toint P.L. Trust regions methods. MPS-SIAM series on optimization. 2000.
  13. Chen J.S., Hu H.Y. Radial basis collocation method and quasi-newton iteration for nonlinear elliptic problems // Numerical Methods for Partial Differential Equations. 2007. V. 24(3). P. 991-1017.
  14. Bellman R., Kalaba R. Kvazilinearizacziya i nelinejny'e kraevy'e zadachi. M.: Mir. 1968.
  15. Verzhbiczkij V.M. Osnovy' chislenny'x metodov: Uchebnik dlya vuzov. Izd. 3-e, ster. M.: Vy'sshaya shkola. 2009.
  16. Dehghan M.A., Shokri A. Meshless method for numerical solution of the one-dimensional wave equation with an integral condition using radial basis functions // Numerical Algorithm. 2009. V. 52(3). P. 461-477.
  17. Dehghan M.A., Shokri A. Numerical solution of the nonlinear Klein-Gordon equation using radial basis functions // Computational and Applied Mathematics. 2009. V. 230(3). P. 400-410.