Hierarchical communication system and device across GPU (Graphics Processing Unit) buffer

The invention provides a hierarchical communication system and equipment across GPU (Graphics Processing Unit) buffer areas. The system comprises a cluster which is divided into two-stage structures, the first-stage structure serves as a server CPU of a node, and the second-stage structure serves as a GPU connected under the CPU. According to the method, communication among nodes is carried out by adopting a hierarchical set communication framework of the MPICH, multi-node configuration is realized by adopting an NCCL for GPU communication inside the nodes, a broadcast algorithm in an MPI is designed based on an ncclbroadcast function of the NCCL, the performance of different MPIBcast is enhanced, and the performance of the different MPIBcast is enhanced by firstly executing broadcast among GPUs and then executing broadcast among the GPUs. Broadcast collective operation among nodes is directly sent out from a GPU buffer area in an NCCL stage in the nodes to realize efficient communication. 本发明提供了一种跨GPU缓冲区的分级通