&`i(.ddlZddlmZddlmZmZddlmZmZm Z m Z m Z ddl m Z mZmZddlmZmZmZmZmZddlmZddlmZmZmZmZmZejeZ eGd d Z!eGd d Z"Gd deZ#dS)N) defaultdict) dataclassfield)AnyDictListOptionalSet)DISABLE_LAUNCH_CONFIG_CHECK_KEYDISABLE_NODE_UPDATERS_KEYFOREGROUND_NODE_LAUNCH_KEY)NodeIDNodeIPNodeKind NodeStatusNodeType) NodeProvider)NODE_KIND_HEADTAG_RAY_NODE_KINDTAG_RAY_NODE_STATUSTAG_RAY_REPLICA_INDEXTAG_RAY_USER_NODE_TYPEcteZdZUdZeeZeee fe d<ee Z e ee d<dS) ScaleRequestzStores desired scale computed by the autoscaler. Attributes: desired_num_workers: Map of worker NodeType to desired number of workers of that type. workers_to_delete: List of ids of nodes that should be removed. )default_factorydesired_num_workersworkers_to_deleteN)__name__ __module__ __qualname____doc__rdictrrrint__annotations__setrr ry/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/autoscaler/batching_node_provider.pyrrsg05uT/J/J/Jhm,JJJ%*U3%?%?%?s6{?????r'rcbeZdZUdZeed<eed<eeed<e ed<dZ ee ed<dS)NodeDataaStores all data about a Ray node needed by the autoscaler. Attributes: kind: Whether the node is the head or a worker. type: The user-defined type of the node. replica_index: An identifier for nodes in a replica of a TPU worker group. This value is set as a Pod label by a GKE webhook when TPUs are requested ip: Cluster-internal ip of the node. ip can be None if the ip has not yet been assigned. status: The status of the node. You must adhere to the following semantics for status: * The status must be "up-to-date" if and only if the node is running. * The status must be "update-failed" if and only if the node is in an unknown or failed state. * If the node is in a pending (starting-up) state, the status should be a brief user-facing description of why the node is pending. kindtypeipstatusN replica_index) rrr r!rr$rr rrr/strr&r'r(r*r*&sa$ NNN NNN #'M8C='''''r'r*c heZdZdZdeeefdeddfdZdeee ffdZ de ddfd Z dd Z d eeefdeefd Zd ZdeeeffdZdedeeeffdZdedefdZdeeefdeeefdedeeeeffdZdedeeeeffdZdS)BatchingNodeProvideraAbstract subclass of NodeProvider meant for use with external cluster managers. Batches reads of cluster state into a single method, get_node_data, called at the start of an autoscaling update. Batches modifications to cluster state into a single method, submit_scale_request, called at the end of an autoscaling update. Implementing a concrete subclass of BatchingNodeProvider only requires overriding get_node_data() and submit_scale_request(). See the method docstrings for more information. Note that an autoscaling update may be conditionally cancelled using the optional method safe_to_scale() of the root NodeProvider. provider_config cluster_namereturnNctj|||i|_|tddusJdtd|t ddusJdt d|t ddusJdt dd|_t|_ ttt|_ dS)NFTz'To use BatchingNodeProvider, must set `z:True`.)r__init__node_data_dictgetr r r scale_change_neededr scale_requestrlistr0replica_index_to_nodes)selfr3r4s r(r7zBatchingNodeProvider.__init__Ts  dO\BBB68    95 A AT I I I W5N W W W J I I""#BEJJdRRR 9/ 9 9 9SRR    :E B Bd J J J X5O X X X K J J$) )^^'2$s)&<&<###r'ct)a8Queries cluster manager for node info. Returns a mapping from node id to NodeData. Each NodeData value must adhere to the semantics of the NodeData docstring. (Note in particular the requirements for NodeData.status.) Consistency requirement: If a node id was present in ScaleRequest.workers_to_delete of a previously submitted scale request, it should no longer be present as a key in get_node_data. (Node termination must be registered immediately when submit_scale_request returns.) NotImplementedErrorr>s r( get_node_dataz"BatchingNodeProvider.get_node_datats "!r'r;ct)aTells the cluster manager which nodes to delete and how many nodes of each node type to maintain. Consistency requirement: If a node id was present in ScaleRequest.workers_to_delete of a previously submitted scale request, it should no longer be present as key in get_node_data. (Node termination must be registered immediately when submit_scale_request returns.) r@)r>r;s r(submit_scale_requestz)BatchingNodeProvider.submit_scale_requests "!r'cV|jr||jd|_dS)z3Submit a scale request if it is necessary to do so.FN)r:rEr;rBs r( post_processz!BatchingNodeProvider.post_processs2  # :  % %d&8 9 9 9#(   r' tag_filterscd__tt _tj}j |D]6}j|j }| j | |7fd|D}|S)NF)rrcg|]A}|k?|BSr&)items node_tags).0noder>rHs r( z=BatchingNodeProvider.non_terminated_nodes..sR     ""dnnT&:&:&@&@&B&BBB BBBr') r:rCr8rcur_num_workersr%r;r<keysr=clearr/append)r>rH all_nodesnode_idr/filtered_nodess`` r(non_terminated_nodesz)BatchingNodeProvider.non_terminated_nodess#( "0022* $ 4 4 6 6!ee   ,113344  #))+++  K KG /8FM(+M:AA'JJJ      !    r'c6||jS)zCReturns dict mapping node type to the number of nodes of that type.)_cur_num_workersr8rBs r(rPz$BatchingNodeProvider.cur_num_workerss$$T%8999r'r8ctt}|D](}|jtkr||jxxdz cc<)|S)N)rr#valuesr+rr,)r>r8num_workers_dict node_datas r(rYz%BatchingNodeProvider._cur_num_workerssb&s++'..00 2 2I~// Y^ , , , 1 , , , ,r'rUc|j|}t|jt|jt |ji}|j|j|t<|SN) r8rr+rr.rr,r/r)r>rUr^tagss r(rLzBatchingNodeProvider.node_tagssJ'0 y~ !1 "IN   " .*3*AD& ' r'c&|j|jSr`)r8r-)r>rUs r( internal_ipz BatchingNodeProvider.internal_ips"7+..r' node_configracountcb|t}|jj|xx|z cc<d|_dS)NT)rr;rr:)r>rdrare node_types r( create_nodez BatchingNodeProvider.create_nodes?/0  .y999UB999#'   r'c||jjvr td|ddS||jvr td|ddS|j|j}|jj|dkrtd|d|jj|xxdzcc<|jj|| |}t|vrk|t}|j |D]P}||jjvr@|jj|t d|d |d Qd |_ dS) Nz#Autoscaler tried to terminate node z8 twice in the same update. Skipping termination request.z*Autoscaler tried to terminate unkown node z. Skipping termination request.rz>NodeProvider attempted to request less than 0 workers of type r[zAutoscaler terminating node z in multi-host replica .T)r;rloggerwarningr8r,rAssertionErroraddrLrr=infor:)r>rUrgranode_replica_index worker_ids r(terminate_nodez#BatchingNodeProvider.terminate_nodes d(: : : NN2g222    F $- - - NN2W222    F'05    1) < A A >>>>  .y999Q>999 ,00999~~g&& D ( (!%&;!< !89KL   D$6$HHH&8<(15c3h(HK( $sCx. !((((+(c+(htCH~.F+(+(+(+(+(+(r'r2)$logging collectionsr dataclassesrrtypingrrrr r !ray.autoscaler._private.constantsr r r ray.autoscaler._private.utilrrrrrray.autoscaler.node_providerrray.autoscaler.tagsrrrrr getLoggerrrkrr*r2r&r'r(r|s######((((((((11111111111111 XWWWWWWWWWWWWW555555  8 $ $  @ @ @ @ @ @ @  @ ((((((( (4~(~(~(~(~(<~(~(~(~(~(r'