&`ix)ddlZddlmZddlmZmZmZmZddlm Z m Z ddl m Z ddl mZejeZeGddZdS) N) ModuleType)AnyDictListOptionalDockerCommandRunnerSSHCommandRunner)CommandRunnerInterface) DeveloperAPIceZdZdZdeeefdeddfdZdefdZ deeefde efd Z d edefd Z d edefd Z d edeeeffd Zd edefdZd edefdZd+dededefdZdeeefdeeefdedeeeeffdZdeeefdeeefdedeeefdeeefdeeeeff dZd edeeefddfdZd edeeeeffdZde edeeeeffdZedeefdZed eeefdeeeffd!Z d,d"ed ed#eeefded$eded%eeeefdefd&Z d eeefdeeeffd'Z!ed eeefdeeeffd(Z"defd)Z#d-d*Z$dS). NodeProvideraInterface for getting and returning nodes from a Cloud. **Important**: This is an INTERNAL API that is only exposed for the purpose of implementing custom node providers. It is not allowed to call into NodeProvider methods from any Ray package outside the autoscaler, only to define new implementations of NodeProvider for use with the "external" node provider option. NodeProviders are namespaced by the `cluster_name` parameter; they only operate on nodes within that namespace. Nodes may be in one of three states: {pending, running, terminated}. Nodes appear immediately once started by `create_node`, and transition immediately to terminated when `terminate_node` is called. Threading and concurrency: - The autoscaler calls the following methods from multiple threads (NodeLauncher, NodeUpdaterThread, autoscaler main loop, and NodeProviderAdapter executors). - These methods MUST be thread-safe: non_terminated_nodes, is_running, is_terminated, node_tags, internal_ip, external_ip, get_node_id, create_node/create_node_with_resources_and_labels, set_node_tags, terminate_node/terminate_nodes. TODO (rueian): make sure all the existing implementations are thread-safe. provider_config cluster_namereturnNc>||_||_i|_i|_dSN)rr_internal_ip_cache_external_ip_cache)selfrrs p/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/autoscaler/node_provider.py__init__zNodeProvider.__init__)s(.(2424cdS)zReturns whether this provider is readonly. Readonly node providers do not allow nodes to be created or terminated. Frs r is_readonlyzNodeProvider.is_readonly/s ur tag_filtersct)aReturn a list of node ids filtered by the specified tags dict. This list must not include terminated nodes. For performance reasons, providers are allowed to cache the result of a call to non_terminated_nodes() to serve single-node queries (e.g. is_running(node_id)). This means that non_terminate_nodes() must be called again to refresh results. Examples: >>> from ray.autoscaler.node_provider import NodeProvider >>> from ray.autoscaler.tags import TAG_RAY_NODE_KIND >>> provider = NodeProvider(...) # doctest: +SKIP >>> provider.non_terminated_nodes( # doctest: +SKIP ... {TAG_RAY_NODE_KIND: "worker"}) ["node-1", "node-2"] NotImplementedError)rrs rnon_terminated_nodesz!NodeProvider.non_terminated_nodes6s $"!rnode_idct)z-Return whether the specified node is running.r rr#s r is_runningzNodeProvider.is_runningJ!!rct)z0Return whether the specified node is terminated.r r%s r is_terminatedzNodeProvider.is_terminatedNr'rct)z1Returns the tags of the given node (string dict).r r%s r node_tagszNodeProvider.node_tagsRr'rct)z*Returns the external ip of the given node.r r%s r external_ipzNodeProvider.external_ipVr'rct)z3Returns the internal ip (Ray ip) of the given node.r r%s r internal_ipzNodeProvider.internal_ipZr'rF ip_addressuse_internal_ipcpfd}|sHi}rjnj}rjnj}|D]}||||<|sGrdt j}ndt j}t dd|z|S)a*Returns the node_id given an IP address. Assumes ip-address is unique per node. Args: ip_address: Address of node. use_internal_ip: Whether the ip address is public or private. Raises: ValueError: If not found. cprjSjSr)rgetr)r0rr1sr find_node_idz.NodeProvider.get_node_id..find_node_idls9 ?.22:>>>.22:>>>rzWorker internal IPs: zWorker external IP: zip z not found. )r"r/r-rrlist ValueError) rr0r1r5 all_nodesip_funcip_cacher# known_msgs ``` r get_node_idzNodeProvider.get_node_id^s ? ? ? ? ? ? ? |~~ 511"55I*9Od&&t?OG+:W''@W % 5 5-4))**|~~ I SSD9P4Q4QSS R48O3P3PRR ;:;;;iGHH H|~~r node_configtagscountct)aPCreates a number of nodes within the namespace. Optionally returns a mapping from created node ids to node metadata. Optionally may throw a ray.autoscaler.node_launch_exception.NodeLaunchException which the autoscaler may use to provide additional functionality such as observability. r )rr=r>r?s r create_nodezNodeProvider.create_nodes "!r resourceslabelsc0||||S)aSCreate nodes with a given resource and label config. This is the method actually called by the autoscaler. Prefer to implement this when possible directly, otherwise it delegates to the create_node() implementation. Optionally may throw a ray.autoscaler.node_launch_exception.NodeLaunchException. )rA)rr=r>r?rBrCs r%create_node_with_resources_and_labelsz2NodeProvider.create_node_with_resources_and_labelss  T5999rct)z9Sets the tag values (string dict) for the specified node.r )rr#r>s r set_node_tagszNodeProvider.set_node_tagsr'rct)z|Terminates the specified node. Optionally return a mapping from deleted node ids to node metadata. r r%s rterminate_nodezNodeProvider.terminate_nodes "!rnode_idsc|D]D}td|||EdS)zTerminates a set of nodes. May be overridden with a batch method, which optionally may return a mapping from deleted node ids to node metadata. z"NodeProvider: {}: Terminating nodeN)loggerinfoformatrI)rrJr#s rterminate_nodeszNodeProvider.terminate_nodessP   ) )G KK<CCGLL M M M    ( ( ( (trcdS)a>The maximum number of nodes which can be terminated in one single API request. By default, this is "None", which means that the node provider's underlying API allows infinite requests to be terminated with one request. For example, AWS only allows 1000 nodes to be terminated at once; to terminate more, we must issue multiple separate API requests. If the limit is infinity, then simply set this to None. This may be overridden. The value may be useful when overriding the "terminate_nodes" method. Nrrs rmax_terminate_nodesz NodeProvider.max_terminate_nodess trcluster_configc|S)z?Bootstraps the cluster config by adding env defaults if needed.rrRs rbootstrap_configzNodeProvider.bootstrap_configs r log_prefix auth_configprocess_runner docker_configcd|||||||d}|r|ddkr t|fi|Stdi|S)aReturns the CommandRunner class used to perform SSH commands. Args: log_prefix: stores "NodeUpdater: {}: ".format(). Used to print progress in the CommandRunner. node_id: the node ID. auth_config: the authentication configs from the autoscaler yaml file. cluster_name: the name of the cluster. process_runner: the module to use to run the commands in the CommandRunner. E.g., subprocess. use_internal_ip: whether the node_id belongs to an internal ip or external ip. docker_config: If set, the docker information of the docker container that commands should be run on. )rVr#providerrWrrXr1container_nameNrr) rrVr#rWrrXr1rY common_argss rget_command_runnerzNodeProvider.get_command_runnersi6%&(,.    3]+;<BB&}DD DD D#22k22 2rc|S)z?Returns a new cluster config with custom configs for head node.r)rrRs rprepare_for_head_nodez"NodeProvider.prepare_for_head_nodesrc|S)z=Fills out missing "resources" field for available_node_types.rrTs r&fillout_available_node_types_resourcesz3NodeProvider.fillout_available_node_types_resourcess rcdS)aQOptional condition to determine if it's safe to proceed with an autoscaling update. Can be used to wait for convergence of state managed by an external cluster manager. Called by the autoscaler immediately after non_terminated_nodes(). If False is returned, the autoscaler will abort the update. Trrs r safe_to_scalezNodeProvider.safe_to_scales trcdS)z]This optional method is executed at the end of StandardAutoscaler._update(). Nrrs r post_processzNodeProvider.post_processs  r)Fr)rN)%__name__ __module__ __qualname____doc__rstrrrboolrrr"r&r)r+r-r/r<intrrAfloatrErGrIrOpropertyrQ staticmethodrUrr r_rarcrergrrrrr sf65S#X5c5d5555 T"S#X"49""""("#"$"""""S"T""""""c3h"""""3"3"""""3"3""""$$c$D$S$$$$L "S> "15c3h "HK " $sCx. ! " " " ":#s(^:38n: : U # : S#X : $sCx. !::::$"S"S#X"4"""""c"htCH~.F"""" S htCH~6N     Xc]   X c3hDcN\37&3&3&3&3#s(^ &3  &3 # &3&3 S#X/&3 &3&3&3&3PDcNtCQTH~S#X c3h\ t      rr)loggingtypesrtypingrrrr&ray.autoscaler._private.command_runnerr r ray.autoscaler.command_runnerr ray.util.annotationsr getLoggerrhrLrrrrrys,,,,,,,,,,,,XXXXXXXX@@@@@@------  8 $ $E E E E E E E E E E r