350 rub
Journal Science Intensive Technologies №1 for 2014 г.
Article in number:
First generation of Angara high-speed interconnection network
Authors:
I.A. Zhabin - Head RTL Designer, JSC «NICEVT». E-mail: zhabin@nicevt.ru
D.V. Makagon - Senior Sostware Engineer, JSC «NICEVT». E-mail: makagond@nicevt.ru
D.A. Polyakov - Sostware Engineer, JSC «NICEVT». E-mail: polyakov@nicevt.ru
A.S. Simonov - Head of Department, JSC «NICEVT». E-mail: simonov@nicevt.ru
E.L. Syromyatnikov - Senior Research Engineer, JSC «NICEVT». E-mail: syromiatnikov@nicevt.ru
A.N. Shcherbak - Senior Digital Design Engineer, JSC «NICEVT». E-mail: andrey.shcherbak@nicevt.ru
Abstract:
In our days supercomputers are built with tens and even hundreds of thousands of nodes connected by high-speed interconnection networks, so the efficiency of the whole system is largely determined by the interconnection network. All interconnection networks can be classified as commercially available and proprietary/custom. The commodity interconnection network market is mostly dominated by InfiniBand and Ethernet networks. Typical examples of the proprietary networks are interconnects used in Blue Gene, Tianhe-2 and Tianhe-1A, K Computer and Cray Titan. The commercially available networks being universal are hardly suitable for the high-end systems with tough requirements on the scalability, reliability and performance. The purchase of the top proprietary networks in Russia is practically impossible. This situation makes the development of a competitive Russian high-speed interconnect an extremely topical issue. JSC «NICEVT» is developing Angara interconnection network for precisely this niche. The first generation of network routers based on Angara EC8430 ASIC has already appeared in 2013. This is a unique result for Russia. The EC8430 ASIC was fabricated with TSMC 90 nm process, die size is 13.0x10.5 mm with over 180 million transistors. The network adapter PCB is manufactured by JSC "NICEVT". Adapter has up to 8 high-speed connectors operating up to 75 Gbps each and a PCI Express 2.0 x16 interface with a host system. Angara interconnection network is planned to be supplied in two variants: as standard commercially available PCI Express network adapters for cluster systems with standard processors and chipsets, and as an integrated part of Angara Computing Platform server boards.
Pages: 21-27
References

  1. Dongarra J. Visit to the National University for Defense Technology Changsha, China. Technical report, Oak Ridge National Laboratory, USA, 2013. http://www.netlib.org/utk/people/JackDongarra/PAPERS/tianhe-2-dongarra-report.pdf
  2. Korzh A.A., Makagon D.V., Zhabin I.A., Sy'romyatnikov E.L. i dr. Otechestvennaya kommunikaczionnaya set' 3D-tor s podderzhkoj global'no adresuemoj pamyati dlya superkomp'yuterov transpetaflopsnogo urovnya proizvoditel'nosti // Trudy' mezhdunar. nauch. konf. «Parallel'ny'e vy'chislitel'ny'e texnologii» (PaVT-2010). (Ufa, 29 marta - 2 aprelya 2010 g.). Chelyabinsk: Izdatel'skij czentr JuurGU. 2010. S. 227-237. http://omega.sp.susu.ac.ru/books/ conference/PaVT2010/full/134.pdf
  3. Dally W. and Towles B. Principles and Practices of Interconnection Networks. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2003.
  4. Duato J., Yalamanchili S. and Lionel N. Interconnection Networks: An Engineering Approach. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2002.
  5. Sy'romyatnikov E.L., Makagon D.V., Paruta S.I., Rumyanczev A.A. Realizacziya apparatnoj podderzhki kollektivny'x operaczij v marshrutizatore vy'sokoskorostnoj kommunikaczionnoj seti s topologiej «mnogomerny'j tor» // Uspexi sovremennoj radioe'lektroniki. 2012. № 1. S. 11-15.