&`ihPddlZddlmZmZmZmZddlZddlmZm Z ddl m Z ddl m Z mZddlmZddlmZddlmZdd lmZmZdd lmZdahd Zd ZeGd dZedededefdZ ededeefdZ!ee d0deee"e#fde"de"dee"dee"deee"e"fdefdZ$eededdfdZ%eede"defd Z&eed1dede'fd!Z(edeefd"Z)ded#eddfd$Z* d2deee"e#fde"dee"dee"deee"e"fdef d%Z+deee"e#ffd&Z,deee"e"ffd'Z-d(Z.d)Z/ d3d+ed#ed,ed-ed.e"deee"dfdefd/Z0dS)4N)DictListOptionalUnion)$PLACEMENT_GROUP_BUNDLE_RESOURCE_NAME hex_to_binary) auto_init_ray)client_mode_should_convertclient_mode_wrap)validate_label_selector)get_ray_doc_version)PlacementGroupID) DeveloperAPI PublicAPI) PlacementGroupSchedulingStrategy>PACKSPREAD STRICT_PACK STRICT_SPREADcXtrdStjdd}|adS)Nr)num_cpusc|SNplacement_groups l/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/util/placement_group.pybundle_reservation_check_funczX_export_bundle_reservation_check_method_if_needed..bundle_reservation_check_func"s)bundle_reservation_checkrayremote)rs r1_export_bundle_reservation_check_method_if_neededr#sDZ =rceZdZdZeddZ ddddeeefdZ e d Z dd Z dd e eefdefdZe deefdZe defdZddZdZdZdS)PlacementGroupzA handle to a placement group.returncBttjSr)r%rnilrrremptyzPlacementGroup.empty-s.244555rNidzray._raylet.PlacementGroupID bundle_cachec"||_||_dSr)r*r+)selfr*r+s r__init__zPlacementGroup.__init__1s (rc4|jSr)r*is_nilr-s ris_emptyzPlacementGroup.is_empty9sw~~rray._raylet.ObjectRefc,|tt|jdksJdt|jtt ||S)aReturns an ObjectRef to check ready status. This API runs a small dummy task to wait for placement group creation. It is compatible to ray.get and ray.wait. Example: .. testcode:: import ray pg = ray.util.placement_group([{"CPU": 1}]) ray.get(pg.ready()) pg = ray.util.placement_group([{"CPU": 1}]) ray.wait([pg.ready()]) rzeready() cannot be called on placement group object with a bundle length == 0, current bundle length: r)scheduling_strategy)_fill_bundle_cache_if_neededr#lenr+r optionsrr"r1s rreadyzPlacementGroup.ready=s$ ))+++9;;;4$%%*** (4$%% ( (+** (// @QU V V V0  &,, rtimeout_secondsc,t|j|S)zWait for the placement group to be ready within the specified time. Args: timeout_seconds(float|int): Timeout in seconds. Return: True if the placement group is created. False otherwise. )_call_placement_group_readyr*)r-r;s rwaitzPlacementGroup.wait]s+47ODDDrc8||jS)z=List[Dict]: Return bundles belonging to this placement group.)r6r+r1s r bundle_specszPlacementGroup.bundle_specsfs ))+++  rcR|t|jSr)r6r7r+r1s r bundle_countzPlacementGroup.bundle_countls% ))+++4$%%%rcJ|jst|j|_dSdSr)r+_get_bundle_cacher*r1s rr6z+PlacementGroup._fill_bundle_cache_if_neededqs/  ; 1$' : :D    ; ;rcPt|tsdS|j|jkS)NF) isinstancer%r*)r-others r__eq__zPlacementGroup.__eq__us(%00 5w%(""rc*t|jSr)hashr*r1s r__hash__zPlacementGroup.__hash__zsDG}}r)r&r%r)r&r3)r:)r&N)__name__ __module__ __qualname____doc__ staticmethodr)rrrr.propertyr2r9rfloatintboolr>r@rBr6rHrKrrrr%r%)s\((666\6 .2)) *)tDz*))))  X @EEE%*$5EtEEEE!d4j!!!X! &c&&&X&;;;;### rr%pg_idr;r&ctjjj}||j||Sr)r!_privateworker global_workercheck_connected core_workerwait_placement_group_ready)rUr;rXs rr=r=~s: \ .F    8 8 P PPrctjjj}|t tjjj|dS)Nbundles) r!rWrXrYrZliststateplacement_group_tablevalues)rUrXs rrDrDs] \ .F    66u==iHOOQQ  rrr^strategynamelifetime_soft_target_node_idbundle_label_selectorctjjj}|t ||||||g}|dkrd}nd}|j||||||}t|S)aMAsynchronously creates a PlacementGroup. Args: bundles: A list of bundles which represent the resources requirements. strategy: The strategy to create the placement group. - "PACK": Packs Bundles into as few nodes as possible. - "SPREAD": Places Bundles across distinct nodes as even as possible. - "STRICT_PACK": Packs Bundles into one node. The group is not allowed to span multiple nodes. - "STRICT_SPREAD": Packs Bundles across distinct nodes. name: The name of the placement group. lifetime: Either `None`, which defaults to the placement group will fate share with its creator and will be deleted once its creator is dead, or "detached", which means the placement group will live as a global object independent of the creator. _soft_target_node_id: (Private, Experimental) Soft hint where bundles of this placement group should be placed. The target node is specified by it's hex ID. If the target node has no available resources or died, bundles can be placed elsewhere. This currently only works with STRICT_PACK pg. bundle_label_selector: A list of label selectors to apply to a placement group on a per-bundle level. Raises: ValueError: if bundle type is not a list. ValueError: if empty bundle or empty resource bundles are given. ValueError: if the wrong lifetime arguments are given. Return: PlacementGroup: Placement group object. r^rdrfrgrhNdetachedTF) r!rWrXrYrZvalidate_placement_groupr[create_placement_groupr%) r^rdrerfrgrhrXrkplacement_group_ids rrrsZ\ .F 13 $ ":+BB   , - --rrc|Jtjjj}||j|jdS)znAsynchronously remove placement group. Args: placement_group: The placement group to delete. N)r!rWrXrYrZr[remove_placement_groupr*)rrXs rrprpsO  & & & \ .F  --o.@AAAAArplacement_group_namec\|stdtjjj}|tjjj||j}|td|ttt|dS)zGet a placement group object with a global name. Returns: None if can't find a placement group with the given name. The placement group object otherwise. z6Please supply a non-empty value to get_placement_groupNz-Failed to look up placement group with name: rn) ValueErrorr!rWrXrYrZr`get_placement_group_by_name namespacer%rr)rqrXplacement_group_infos rget_placement_grouprws SQRRR \ .F <-3OOf.# R

>>777 M M M)I M M M   ))) +' + + +   *)rct|ts tdt|dt |dkrtd|D]}t|t rVt d|Dr+t d|Dstdt |dks+t d|Drtd |d |vr,tj d td td dS)zGValidates each bundle and raises a ValueError if any bundle is invalid.z,Placement group bundles must be a list, got rrzBundles must be a non-empty list of resource dictionaries. For example: `[{"CPU": 1.0}, {"GPU": 1.0}]`. Got empty list instead.c3@K|]}t|tVdSrrFstr.0ks r z$_validate_bundles..s,AAaz!S))AAAAAArc3NK|] }t|ttfV!dSr)rFrSrRrvs rrz$_validate_bundles..s0LLqz!c5\22LLLLLLrzgBundles must be a non-empty list of resource dictionaries. For example: `[{"CPU": 1.0}, {"GPU": 1.0}]`.c3"K|] }|dkV dS)rNr)rresource_values rrz$_validate_bundles..s8# # $2Na # # # # # # rzPBundles cannot be an empty dictionary or resources with only 0 values. Bundles: object_store_memoryzSetting 'object_store_memory' for bundles is deprecated since it doesn't actually reserve the required object store memory. Use object spilling that's enabled by default (https://docs.ray.io/en/zb/ray-core/objects/object-spilling.html) instead to bypass the object store memory size limitation.) stacklevelN) rFr_rstyper7dictallkeysrbwarningswarnr DeprecationWarning)r^bundles rrrs gt $ $  Nd7mm N N N    7||q &   64(( AA6;;==AAAAA LLFMMOOLLLLL  2  v;;!  s# # 6.s,IIaz!S))IIIIIIrc3@K|]}t|tVdSrrrs rrz2_validate_bundle_label_selector..s,KKaz!S))KKKKKKrzBundle label selector must be a list of string dictionary label selectors. For example: `[{ray.io/market_type": "spot"}, {"ray.io/accelerator-type": "A100"}]`.zPInvalid label selector provided in bundle_label_selector list. Detailed error: '') rFr_rsrr7rrrrbr )rhlabel_selector error_messages rrrsF +T 2 2  2-.. 2 2 2    !!Q&&/>400 II>3F3F3H3HIIIII KK>3H3H3J3JKKKKK  Z  0??  6%2666  rc|D]M}d}|D]/\}}|tkr||d|krd}n0|rdSNdS)zS If the resource shape cannot fit into every bundle spec, return False TrF)itemsrget) resourcesr@r fit_in_bundleresource requested_vals r_valid_resource_shapers    '0'8'8   #Hm???zz(A&&66 % 7  44  5rc |j}t||}t||}|std|d|d|d|s-td|d|ddd|d dS) NzCannot schedule z7 with the placement group because the resource request z6 cannot fit into any bundles for the placement group, rz5 with the placement group because the actor requires CPUrzO CPU for creation, but it cannot fit into any bundles for the placement group, z9. Consider creating a placement group with CPU resources.)r@rrsr)rrplacement_resourcestask_or_actor_reprr^resources_validplacement_resources_valids r_validate_resource_shapers*G+Iw??O 56I7 S S   /1 / / / /%, / / /   %   =1 = ="&&ua00 = =   = = =     rdefault#placement_group_capture_child_tasksrrrcp|J|J|dkr|st}n0|dkr*|rt}nt}|st}t|tsJt |||jst |||||S)aConfigure the placement group based on the given context. Based on the given context, this API returns the placement group instance for task/actor scheduling. Params: placement_group_capture_child_tasks: Whether or not the placement group needs to be captured from the global context. bundle_index: The bundle index for tasks/actor scheduling. resources: The scheduling resources. placement_resources: The scheduling placement resources for actors. task_or_actor_repr: The repr of task or actor function/class descriptor. placement_group: The placement group instance. - "default": Default placement group argument. Currently, the default behavior is to capture the parent task' placement group if placement_group_capture_child_tasks is set. - None: means placement group is explicitly not configured. - Placement group instance: In this case, do nothing. Returns: Placement group instance based on the given context. Raises: ValueError: If the bundle index is invalid for the placement group or the requested resources shape doesn't fit to any bundles. Nr)r%r)rzrFr~r2r)rr{rrrrs r+_configure_placement_group_based_on_contextrsP / : : :  )## 5,2244O I % % . 59;;OO,2244O 1(..00 o~ 6 666 6 >>>  #  Y(;=O    r)rrcNNNr)rNNN)r)1rtypingrrrrr!ray._common.utilsrrray._private.auto_init_hookr ray._private.client_mode_hookr r ray._private.label_utilsr ray._private.utilsr ray._rayletrray.util.annotationsrrray.util.scheduling_strategiesrr rr#r%rSrTr=rDrrRrrprwrrarzr~rlrrrrrrrrrs............ QQQQQQQQ555555VVVVVVVV<<<<<<222222((((((88888888KKKKKK$$$  = = = QQQQQQQ QhQ'7Q#QRVQQQQ-$t* "*.26 G.G. $sEz" #G.G. G.sm G. #3- G.  S#X/ G.G.G.G. G.T  BN Bt B B B  B  c n     0 N N> NT N N N N +!Xn%=+!+!+! +!\ # 36      ("*.26 * * $sEz" #* * sm* #3- *  S#X/ *  * * * * Z,tDe$45,,,,^4S#X;OB*   F9B CC)-CCC C  C >345 CCCCCCCr