&`iddlmZmZddlmZmZmZmZmZddl Z ddl m Z ddl m Z erddlZeeedgdfZe Gdd eZdS) )ABCabstractmethod) TYPE_CHECKINGCallableListOptionalTupleN)ReduceOp) DeveloperAPI torch.dtype torch.Tensorc NeZdZdZededdfdZededfdZede j j defd Z ede efd Zdefd Zed d deddfdZe d deedddede edd f dZeedZeedZe d!dZedd dd deddfdZedd dd deddfdZed"dZedefdZeedefdZdS)# Communicatorz Communicator for a group of Compiled Graph actors on NVIDIA GPU. The Compiled Graph execution leverages this internally to support communication between actors in the group. rankreturnNct)a Initialize the communicator from the actor. This is called once by Compiled Graph on each actor to initialize the communicator,before any other methods. Args: rank: The rank of this actor in the group. NotImplementedError)selfrs y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/experimental/channel/communicator.py initializezCommunicator.initializes "!zray.actor.ActorHandlect)zH Get handles of all actors for this communicator group. rrs rget_actor_handleszCommunicator.get_actor_handles' "!ractorct)z| Return the given actor's rank in the group. Args: actor: The actor handle to look up. r)rrs rget_rankzCommunicator.get_rank. "!rct)z+ Return this actor's rank. rrs r get_self_rankzCommunicator.get_self_rank8rrct)z: Return the number of ranks in the group. rrs rget_world_sizezCommunicator.get_world_size?s "!rvaluer peer_rankct)a Send a torch.Tensor to a peer. This returns when the send kernel has been queued, but the kernel may not have completed. Therefore, the caller should ensure that there are no concurrent writes to the sent `value` until the send has finished. Args: value: The torch.Tensor to send. It should already be on this actor's default device. peer_rank: The rank of the actor to send to. r)rr%r&s rsendzCommunicator.sendE "!rshapedtyper allocatorct)a+ Receive a torch.Tensor from a peer and synchronize. After this call returns, the receive buffer is safe to read from from any stream. An RayChannelError will be raised if an error occurred (e.g., remote actor died), and the buffer is not safe to read. Args: shape: The shape of the tensor to receive. dtype: The dtype of the tensor to receive. peer_rank: The rank of the actor to receive from. allocator: A function to allocate the tensor to receive into. r)rr*r+r&r,s rrecvzCommunicator.recvUs *"!rct)zM Return the torch stream context used for receiving tensors. rrs r recv_streamzCommunicator.recv_streaml "!rct)zK Return the torch stream context used for sending tensors. rrs r send_streamzCommunicator.send_streamtr1rsend_bufrecv_bufct)a! Collectively allgather the tensor across the group. Args: send_buf: The input torch.tensor to allgather. It should already be on this actor's default device. recv_buf: The output torch.tensor to store the allgather result. r)rr4r5s r allgatherzCommunicator.allgather|r)ropct)aG Collectively allreduce the tensor across the group. Args: send_buf: The input torch.tensor to allreduce. It should already be on this actor's default device. recv_buf: The output torch.tensor to store the allreduce result. op: The reduce operation. rrr4r5r8s r allreducezCommunicator.allreduce "!rct)aS Collectively reducescatter the tensor across the group. Args: send_buf: The input torch.tensor to reducescatter. It should already be on this actor's default device. recv_buf: The output torch.tensor to store the reducescatter result. op: The reduce operation. rr:s r reducescatterzCommunicator.reducescatterr<rct)z Destroy the GPU communicator. Any destruction and cleanup for the GPU communicator should be done here. Implement as a noop is nothing is needed. rrs rdestroyzCommunicator.destroyr rct)zC Return the type of the communicator (gpu or cpu). rrs rget_transport_namezCommunicator.get_transport_namerrct)z; Return the unique id of the communicator. r)clss rgenerate_communicator_idz%Communicator.generate_communicator_idr1r)N)r4r r5r rN)rN) __name__ __module__ __qualname____doc__rintrrrrayr ActorHandlerrr"r$r(r TorchTensorAllocatorr.propertyr0r3r7r r;r>r@strrB classmethodrErrrrs "s "t " " "^ ""4(?#@"""^" "ci3""""^""x}"""^" """""  ". "S "T " " "^ " 59 ""Sz"" " 01 "  """^",""^X" ""^X"  "  "! "  " " "^ "" "!"  "  """^""" "!"  "  """^"""""^""C"""^" """"^["""rr)abcrrtypingrrrrr rKray.experimental.util.typesr ray.util.annotationsr torchrJrMrrQrrrWs########AAAAAAAAAAAAAA 000000------LLL  s] ;^ KLu"u"u"u"u"3u"u"u"u"u"r