Proposal of Container-Based HPC Structures and Performance Analysis
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
High-performance computing (HPC) provides to researchers a powerful ability to resolve problems withintensive computations, such as those in the math and medical fields. When an HPC platform is provided as aservice, users may suffer from unexpected obstacles in developing and running applications due to restricteddevelopment environments and dependencies. In this context, operating system level virtualization can be asolution for HPC service to ensure lightweight virtualization and consistency in Dev-Ops environments. Therefore, this paper proposes three types of typical HPC structure for container environments built withHPC container and Docker. The three structures focus on smooth integration with existing HPC jobframework, message passing interface (MPI). Lastly, the performance of the structures is analyzed with HighPerformance Linpack benchmark from the aspect of performance degradation in network communicationsunder Docker.
Abstract
High-performance computing (HPC) provides to researchers a powerful ability to resolve problems withintensive computations, such as those in the math and medical fields. When an HPC platform is provided as aservice, users may suffer from unexpected obstacles in developing and running applications due to restricteddevelopment environments and dependencies. In this context, operating system level virtualization can be asolution for HPC service to ensure lightweight virtualization and consistency in Dev-Ops environments. Therefore, this paper proposes three types of typical HPC structure for container environments built withHPC container and Docker. The three structures focus on smooth integration with existing HPC jobframework, message passing interface (MPI). Lastly, the performance of the structures is analyzed with HighPerformance Linpack benchmark from the aspect of performance degradation in network communicationsunder Docker.
참고문헌 (10)
- D. M. Jacobsen, "Contain this, unleashing Docker for HPC", Proceedings of the Cray User Group (2015)
- M. de Bayser, "Integrating MPI with Docker for HPC", Proceedings of 2017 IEEE International Conference on Cloud Engineering (IC2E), pp.259~265 (2017)
- J. Sparks, "HPC containers in use", Proceedings of the Cray User Group (2017)
- J. H. Huh, "Design and test bed experiments of server operation system using virtualization technology", Human-centric Computing and Information Sciences, 6 (2016)
- "Portable, high-performance containers for HPC" (2017)[URL]
- J. Higgins, "High Performance Computing", pp.506~513 (2015), Springer
- G. M. Kurtzer, "Singularity: scientific containers for mobility of compute", PloS One, 12(5) (2017)
- J. P. Martin, "Exploring the support for high performance applications in the container runtime environment", Human-centric Computing and Information Sciences, 8 (2018)
- N. Nguyen, "Distributed MPI cluster with Docker swarm mode", Proceedings of 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC), pp.1~7 (2017)
- B. Gerofi, "Toward full specialization of the HPC software stack: reconciling application containers and lightweight multi-kernels", Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers (ROSS) (2017)