&`i^)ddlZddlZddlmZmZddlmZddlmZm Z m Z m Z m Z ddl mZmZddlmZeGdde ZdS) N)ABCMetaabstractmethod)deque)AnyDictListOptionalUnion)OverrideToImplementCustomLogic5OverrideToImplementCustomLogic_CallToSuperRecommended) DeveloperAPIc eZdZUdZdZeed< d+dedefdZe d efd Z e d e d dfd Z ed efd ZdZdZdZdZdZdZdZdZdZdZdZd,dZd-dZedeee fd dfdZ!e" d.de#eee fd dfdZ$e"d eee ffdZ%e"deee fd dfd Z&e"e'd/d eee ffd!Z(ed efd"Z)ed#e*dd dfd$Z+ed%e d dfd&Z,e d0d'ed(ed e-e e*e ffd)Z.ed1d'ed e-e dffd*Z/dS)2 StatsBaseaA base class for Stats. Stats are meant to be used to log values to and then aggregate them in a tree. Therefore, we log to stats in two different ways: - On a leaf component, we log values directly by pushing. - On a non-leaf component, we only aggregate incoming values. Additionally, we pay special respect to Stats that live at the root of the tree. These may have a different behaviour (example: a lifetime sum). Note the tight coupling between StatsBase and MetricsLogger. Nstats_cls_identifierFTis_rootis_leafcn||_||_i|_|jsd|_|j JddS)aInitializes a StatsBase object. Args: is_root: If True, the Stats object is a root stats object. is_leaf: If True, the Stats object is a leaf stats object. Note: A stats object can be both root and leaf at the same time. Note: A stats object can also be neither root nor leaf ("intermediate" stats that only aggregate from other stats but are not at the root). Nz0stats_cls_identifier must be set in the subclass)rr _start_times latest_mergedr)selfrrs v/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/metrics/stats/base.py__init__zStatsBase.__init__"sR  | =8s urtimec2|jrtddS)a Sets the reference time for this Stats object. This is important because the component that tracks the time between reduce cycles is not Stats, but MetricsLogger. Args: time: The time to establish as the reference time for this Stats object. z`initialize_throughput_reference_time must be overridden for stats objects that have throughputs.N)r ValueError)rrs r$initialize_throughput_reference_timez.StatsBase.initialize_throughput_reference_timeFs.   r   rcdS)z/Returns the length of the internal values list.Nrrs r__len__zStatsBase.__len__Us  rc|d}t|tttfrt d|dt |S)NTcompileCan not convert z to float.)peek isinstancelisttuplerr!floatrvalues r __float__zStatsBase.__float__ZsU $ '' edE51 2 2 B@@@@AA AU||rc|d}t|tttfrt d|dt |S)NTr&r(z to int.)r)r*r+r,rr!intr.s r__int__zStatsBase.__int__`sU $ '' edE51 2 2 @>>>>?? ?5zzrcBt|t|kSNr-rothers r__eq__zStatsBase.__eq__fT{{eEll**rcBt|t|kSr5r6r7s r__le__zStatsBase.__le__ir:rcBt|t|kSr5r6r7s r__ge__zStatsBase.__ge__lr:rcBt|t|kSr5r6r7s r__lt__zStatsBase.__lt__oT{{U5\\))rcBt|t|kSr5r6r7s r__gt__zStatsBase.__gt__rrArc@t|t|zSr5r6r7s r__add__zStatsBase.__add__uT{{U5\\))rc@t|t|z Sr5r6r7s r__sub__zStatsBase.__sub__xrFrc@t|t|zSr5r6r7s r__mul__zStatsBase.__mul__{rFrc&t||Sr5r6)rfmts r __format__zStatsBase.__format__~s++s%%%rcbtj}tj|j|<|S)zCalled when entering a context (with which users can measure a time delta). Returns: This stats instance. ) threading get_identr perf_counterr)r thread_ids r __enter__zStatsBase.__enter__s- ')) '+'8':':)$ rctj}|j|Jtj|j|z }|||j|=dS)zCalled when exiting a context (with which users can measure a time delta). This pushes the time delta since __enter__ to this Stats object. N)rOrPrrrQpush)rexc_type exc_valuetbrR time_delta_ss r__exit__zStatsBase.__exit__sd '))  +777(**T->y-II  ,  i ( ( (rstatecl||}|di|}|||S)a Creates a stats object from a state dictionary. Any implementation of this should call this base classe's `stats_object.set_state()` to set the state of the stats object. Args: state: The state to set after instantiation. )r[r)_get_init_args set_state)clsr[ init_argsstatss r from_statezStatsBase.from_statesF&&U&33   i    rinit_overridesc|j|}|r|||jdi|}|S)a4Returns a new stats object with the same settings as `self`. Args: init_overrides: Optional dict of initialization arguments to override. Can be used to change is_root, is_leaf, etc. Returns: A new stats object similar to `self` but missing internal values. ) stats_objectr) __class__r]update)rrcr` new_statss rclonezStatsBase.clonesUN11t1DD  -   ^ , , ,"DN//Y// rcR|j|j|jd}|js |j|d<|S)z&Returns the state of the stats object.)rrrr)rrrrrr[s r get_statezStatsBase.get_states>%)$=||   | 8%)%7E/ " rc|d|_|d|_|j|dksJ|js|d|_dSdS)zySets the state of the stats object. Args: state: The state to set on this StatsBase object. rrrrN)rrrrrks rr^zStatsBase.set_states]Y' Y' (E2H,IIIII| 8!&!7D    8 8rcp||d}|d}||dS||j|jdStd)z;Returns the initialization arguments for this Stats object.Nrr)rrz-Either stats_object or state must be provided)rrr!)rer[rrs rr]zStatsBase._get_init_argssg  I&GI&G""  %'/'/  LMM MrcdSr5rrs r__repr__zStatsBase.__repr__s rincoming_statscdS)zuMerges StatsBase objects. Args: incoming_stats: The list of StatsBase objects to merge. Nr)rrqs rmergezStatsBase.mergerr/c(|js JddS)zPushes a value into this Stats object. Args: value: The value to push. Can be of any type. GPU tensors are moved to CPU memory. zYCannot push values to non-leaf Stats. Non-leaf Stats can only receive values via merge().N)rr.s rrUzStatsBase.pushs3 L g g f g g  g grr'latest_merged_onlycdS)aReturns the result of reducing the internal values list. Note that this method does NOT alter the internal values list in this process. Thus, users can call this method to get an accurate look at the reduced value(s) given the current internal values list. Args: compile: If True, the result is compiled into a single value if possible. latest_merged_only: If True, only considers the latest merged values. This parameter only works on aggregation stats objects (is_leaf=False). When enabled, peek() will only use the values from the most recent merge operation. Returns: The result of reducing the internal values list on CPU memory. Nr)rr'rvs rr)zStatsBase.peekrtrcdS)aReduces the internal values. This method should NOT be called directly by users. It can be used as a hook to prepare the stats object for sending it to the root metrics logger and starting a new 'reduce cycle'. The reduction logic depends on the implementation of the subclass. Meaning that some classes may reduce to a single value, while others do not or don't even contain values. Args: compile: If True, the result is compiled into a single value if possible. If False, the result is a Stats object similar to itself, but with the internal values reduced. Returns: The reduced value or a Stats object similar to itself, but with the internal values reduced. Nr)rr's rreducezStatsBase.reducertr)FT)rr)rNr5)NN)TF)T)0__name__ __module__ __qualname____doc__rstr__annotations__boolrpropertyrr r-r"rr2r$r0r3r9r<r>r@rCrErHrJrMrSrZ classmethodrrrbr r rirlr^ staticmethodr]rprrsrUr r)ryrrrrrs   !%#$$$>>>>>>>8X$  4   $#     ^   +++++++++***************&&& ) ) ) ) tCH~ +   [ ;48 c3h0 ;:$; 4S>   ;: ;8tCH~8$888;:8 ;NNc3hNNN\;:N$ #   ^  D$5 $   ^  g# g$ g g g^ g?D   8< sDI~    ^ &  d eC4D.E   ^   rr) metaclass)rOrabcrr collectionsrtypingrrrr r ray.rllib.utils.annotationsr r ray.util.annotationsr rrrrrs ''''''''33333333333333.-----V V V V V 'V V V V V V r