pylibwholegraph.torch.comm.set_world_info#

pylibwholegraph.torch.comm.set_world_info(world_rank: int, world_size: int, local_rank: int, local_size: int)#

Set the global world’s information. This is used for create common used communicators, like local node communicator, global communicator, or local device communicator.

Parameters:
  • world_rank – world rank of current process.

  • world_size – world size

  • local_rank – local rank of current process in current machine node.

  • local_size – local size of each machine node

Returns:

None