Evolution of GPU virtualization to resource pooling

Abstract

With the rapid development of artificial intelligence, the demand for Graphics Processing Unit (GPU) resources is also increasing rapidly. To improve the efficiency and utilization of GPU resources, virtualization technology has been widely used in the field of GPUs. This article reviews the evolution from GPU virtualization to resource pooling, including device simulation, GPU pass-through, hardware-assisted virtualization, GPU full virtualization, GPU remote-sharing, and GPU resource pools. The advantages and disadvantages of each stage and the challenges faced during the evolution process are also analyzed. This article discusses the difficulties and solutions of GPU resource pool construction, as well as the construction steps and framework, providing a reference for the research and application of GPU resource pooling. © 2023 SPIE.