&`i(ddlmZddlmZddlmZmZmZmZm Z ddl m Z m Z ddl mZddlmZmZddlmZe \ZZe \ZZZeGdd eZed Zd S) )deque)chain)AnyDictListOptionalUnion) try_import_tftry_import_torch) StatsBase)batch_values_to_cpu safe_isnan) DeveloperAPIc eZdZdZdZ d#deeeefde eee fffd Z de e efffd Zde e efddffd Zd Zdefd Zd Zd ZdZdZdZdZdZdZdZdZdZdeddfdZdedddfdZ d$dededeeeeffdZ d%dedeedffd Z!de fd!Z"e#d#de e effd"Z$xZ%S)&PercentilesStatszTA Stats object that tracks percentiles of a series of singular values (not vectors). percentilesNwindowctj|i|||_g|_|g|gd}n't |t r|}ntd||_dS)aInitializes a PercentilesStats instance. Percentiles are computed over the last `window` values across all parallel components. Example: If we have 10 parallel components, and each component tracks 1,000 values, we will track the last 10,000 values across all components. Be careful to not track too many values because computing percentiles is O(n*log(n)) where n is the window size. See https://github.com/ray-project/ray/pull/52963 for more details. Args: percentiles: The percentiles to track. If None, track the default percentiles [0, 50, 75, 90, 95, 99, 100]. If a list, track the given percentiles. N)r2KZ_cdz$`percentiles` must be a list or None) super__init___windowvalues _set_values isinstancelist ValueError _percentiles)selfrrargskwargs __class__s }/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/metrics/stats/percentiles.pyrzPercentilesStats.__init__s& $)&))) 46    666KK  T * * E%KKCDD D'returnct}|j|d<|j|d<|j|d<|SNrrr)r get_staterrr#r$stater's r(r-zPercentilesStats.get_state7s@!!##+h,h#0m r)r/ct|||d|d|_|d|_dSr,)r set_staterrr#r.s r(r1zPercentilesStats.set_state>sQ %    x)))X !-0r)cj|jr$|jrt||j|_dS||_dS)N)maxlen)ris_leafrr)r$ new_valuess r(rzPercentilesStats._set_valuesDs> < %DL % 4<@@@DKKK%DKKKr)c*t|jS)z/Returns the length of the internal values list.)lenrr$s r(__len__zPercentilesStats.__len__Ns4;r)c td)NzNCannot convert to float because percentiles are not reduced to a single value.r"r8s r( __float__zPercentilesStats.__float__Rs \   r)c0|ddS)N__eq__ _comp_errorr$others r(r>zPercentilesStats.__eq__W """""r)c0|ddS)N__le__r?rAs r(rEzPercentilesStats.__le__ZrCr)c0|ddS)N__ge__r?rAs r(rGzPercentilesStats.__ge__]rCr)c0|ddS)N__lt__r?rAs r(rIzPercentilesStats.__lt__`rCr)c0|ddS)N__gt__r?rAs r(rKzPercentilesStats.__gt__crCr)c0|ddS)N__add__r?rAs r(rMzPercentilesStats.__add__f #####r)c0|ddS)N__sub__r?rAs r(rPzPercentilesStats.__sub__irNr)c0|ddS)N__mul__r?rAs r(rRzPercentilesStats.__mul__lrNr)ctN)NotImplementedError)r$comps r(r@zPercentilesStats._comp_erroros!###r)c td)NzWCannot format percentiles object because percentiles are not reduced to a single value.r;)r$fmts r( __format__zPercentilesStats.__format__rs e   r)valuecJtr.t|r|}t|rt dt r.t |t jr|}|j |dS)a Pushes a value into this Stats object. Args: value: The value to be pushed. Can be of any type. PyTorch GPU tensors are kept on GPU until reduce() or peek(). TensorFlow tensors are moved to CPU immediately. z.NaN values are not allowed in PercentilesStatsN) tf is_tensornumpyrr"torchr Tensordetachrappend)r$rZs r(pushzPercentilesStats.pushws  "",,u%% "KKMME e   OMNN N  #Zu|44 #LLNNE 5!!!!!r)incoming_statsctjr Jdtfd|Ds Jdtfd|Ds Jdd|D}ttj|}tj|z}|_js |_dSdS)avMerges PercentilesStats objects. This method assumes that the incoming stats have the same percentiles and window size. It will append the incoming values to the existing values. Args: incoming_stats: The list of PercentilesStats objects to merge. Returns: None. The merge operation modifies self in place. zSPercentilesStats should only be merged at aggregation stages (root or intermediate)c38K|]}|jjkVdSrT)r#.0sr$s r( z)PercentilesStats.merge..s>  45ANd/ /      r)zDAll incoming PercentilesStats objects must have the same percentilesc38K|]}|jjkVdSrT)rrgs r(rjz)PercentilesStats.merge..s=  *+AI %      r)zDAll incoming PercentilesStats objects must have the same window sizecg|] }|j S)r)rhris r( z*PercentilesStats.merge..s7771ah777r)N)r4allr!r from_iterabler latest_merged)r$rdr5 all_valuess` r(mergezPercentilesStats.merges<  a a ` a a     9G      R R Q R R     /=      R R Q R R 87777 %-j99:: $+&&3   | ,!+D    , ,r)TFcompilelatest_merged_onlyc|r|jrtd|r3|j|rd|jDSgS|j}t |}nt |j}||rt||jS|S)aReturns the result of reducing the internal values list. Note that this method does NOT alter the internal values list in this process. Thus, users can call this method to get an accurate look at the reduced value(s) given the current internal values list. Args: compile: If True, the result is compiled into the percentiles list. latest_merged_only: If True, only considers the latest merged values. This parameter only works on aggregation stats (root or intermediate nodes). When enabled, peek() will only use the values from the most recent merge operation. Returns: The result of reducing the internal values list on CPU. zQlatest_merged_only can only be used on aggregation stats objects (is_leaf=False).Nci|]}|dSrTrmrhps r( z)PercentilesStats.peek..s???At???r))r4r"rqr#r rsortcompute_percentiles)r$rtrurqrs r(peekzPercentilesStats.peeks&  $, c   6!)??T->????I .M(77FF)55F  B&vt/@AA A r)ct|j}||g|rt ||jS|}||_|S)zReduces the internal values list. Args: compile: If True, the result is compiled into a single value if possible. Returns: The reduced value on CPU. )r rr{rr|r#clone)r$rtr return_statss r(reducezPercentilesStats.reducesk%T[11    B&vt/@AA Azz|| $ r)c`d|d|jdt|S)NzPercentilesStats(z ; window=z; len=)r}rr7r8s r(__repr__zPercentilesStats.__repr__s1X499;;XXXXSQUYYXXXr)ctj||}|i||d|ddS|i||j|jdSt d)z;Returns the initialization arguments for this Stats object.) stats_objectr/Nrr)rrz-Either stats_object or state must be provided)r _get_init_argsr#rr")rr/ super_argss r(rzPercentilesStats._get_init_argss-rErGrIrKrMrPrRr@rYrcrsr}rr staticmethodr __classcell__)r's@r(rrs^^(/3.2!(!(49d?+!(sEz*+!(!(!(!(!(!(F4S>1tCH~1$111111 %%%        ###############$$$$$$$$$$$$   "#"$""""&,D);$<,,,,,@@E+++8<+ sDI~ ++++ZdeC9K4K.L,Y#YYYYNNc3hNNN\NNNNNr)rc2t|}|dkr d|DSi}|D]p}|dz |dz z}|r|t|||<:t|}|dz}||z }||d|z z|||zz||<q|S)asCompute percentiles from an already sorted list. Note that this will not raise an error if the list is not sorted to avoid overhead. Args: sorted_list: A list of numbers sorted in ascending order percentiles: A list of percentile values (0-100) Returns: A dictionary mapping percentile values to their corresponding data values rci|]}|dSrTrmrxs r(rzz'compute_percentiles..s---A4---r)r)r7 is_integerr) sorted_listrnresultsryindex lower_index upper_indexweights r(r|r|s KAAvv------G   SQU#      $SZZ0GAJJe**K%/K[(FK(AJ7k*V34 AJJ Nr)N) collectionsr itertoolsrtypingrrrrr ray.rllib.utils.frameworkr r "ray.rllib.utils.metrics.stats.baser #ray.rllib.utils.metrics.stats.utilsr rray.util.annotationsrr__r\rr|rmr)r(rs633333333333333EEEEEEEE888888OOOOOOOO------    q =??2qqNqNqNqNqNyqNqNqNh     r)