&`ioNddlmZmZddlmZmZmZmZdZGddeZ dS))ABCabstractmethod)DictListOptionalTuple"RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZEROc zeZdZdZeedefdZeedefdZeede fdZ eede efdZ eede e eeffdZeededeee effd Zeede eefd Zeed eedd fd Zededede e fdZededede efdZede e eeffdZd S)AcceleratorManagerz]This class contains all the functions needed for supporting an accelerator family in Ray.returncdS)zGet the name of the resource representing this accelerator family. Returns: The resource name: e.g., the resource name for NVIDIA GPUs is "GPU" Nry/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/_private/accelerators/accelerator.pyget_resource_namez$AcceleratorManager.get_resource_namercdS)zGet the env var that sets the ids of visible accelerators of this family. Returns: The env var for setting visible accelerator ids: e.g., CUDA_VISIBLE_DEVICES for NVIDIA GPUs. Nrrrr#get_visible_accelerator_ids_env_varz6AcceleratorManager.get_visible_accelerator_ids_env_varrrcdS)zGet the total number of accelerators of this family on the current node. Returns: The detected total number of accelerators of this family. Return 0 if the current node doesn't contain accelerators of this family. Nrrrr!get_current_node_num_acceleratorsz4AcceleratorManager.get_current_node_num_accelerators)rrcdS)aGet the type of the accelerator of this family on the current node. Currently Ray only supports single accelerator type of an accelerator family on each node. The result should only be used when get_current_node_num_accelerators() > 0. Returns: The detected accelerator type of this family: e.g., H100 for NVIDIA GPU. Return None if it's unknown or the node doesn't have accelerators of this family. Nrrrr!get_current_node_accelerator_typez4AcceleratorManager.get_current_node_accelerator_type3rrcdS)aGet any additional resources required for the current node. In case a particular accelerator type requires considerations for additional resources (e.g. for TPUs, providing the TPU pod type and TPU name), this function can be used to provide the additional logical resources. Returns: A dictionary representing additional resources that may be necessary for a particular accelerator type. Nrrrr%get_current_node_additional_resourcesz8AcceleratorManager.get_current_node_additional_resourcesCrrquantitycdS)aValidate the resource request quantity of this accelerator resource. Args: quantity: The resource request quantity to be validated. Returns: (valid, error_message) tuple: the first element of the tuple indicates whether the given quantity is valid or not, the second element is the error message if the given quantity is invalid. Nr)rs r"validate_resource_request_quantityz5AcceleratorManager.validate_resource_request_quantityRrrcdS)zGet the ids of accelerators of this family that are visible to the current process. Returns: The list of visiable accelerator ids. Return None if all accelerators are visible. Nrrrr+get_current_process_visible_accelerator_idsz>AcceleratorManager.get_current_process_visible_accelerator_idscrridsNcdS)zSet the ids of accelerators of this family that are visible to the current process. Args: ids: The ids of visible accelerators of this family. Nr)r s r+set_current_process_visible_accelerator_idsz>AcceleratorManager.set_current_process_visible_accelerator_idsmrr instance_type instancescdS)aGet the number of accelerators of this family on ec2 instance with given type. Args: instance_type: The ec2 instance type. instances: Map from ec2 instance type to instance metadata returned by ec2 `describe-instance-types`. Returns: The number of accelerators of this family on the ec2 instance with given type. Return None if it's unknown. Nrr#r$s r!get_ec2_instance_num_acceleratorsz4AcceleratorManager.get_ec2_instance_num_acceleratorsvs trcdS)aGet the accelerator type of this family on ec2 instance with given type. Args: instance_type: The ec2 instance type. instances: Map from ec2 instance type to instance metadata returned by ec2 `describe-instance-types`. Returns: The accelerator type of this family on the ec2 instance with given type. Return None if it's unknown. Nrr&s r!get_ec2_instance_accelerator_typez4AcceleratorManager.get_ec2_instance_accelerator_types trcdS)zGet accelerator related Ray node labels of the curent node. Returns: A dictionary mapping accelerator related label keys to values. Nrrrr#get_current_node_accelerator_labelsz6AcceleratorManager.get_current_node_accelerator_labelss tr)__name__ __module__ __qualname____doc__ staticmethodrstrrrintrrrrfloatrrboolrrrr"dictr'r)r+rrrr r s%% s   ^\     ^\  s   ^\   x}    ^\    8Der9s########.............R*NNNNNNNNNNr