&`iddlmZddlmZddlmZmZmZmZm Z ddl Z ddl m Z ddlmZddlmZeGdd e ZdS) )deque)chain)AnyDictListOptionalUnionN) StatsBase)batch_values_to_cpu) DeveloperAPIc LeZdZdZdZddeeffd ZdZde e e fffd Z d e e e fddffd Z d e ddfd Zddedee dffdZdefdZ ddededeee e ffdZdedddfdZedde e e ffdZde fdZxZS)ItemSeriesStatsaA Stats object that tracks a series of items. Use this if you want to track a series of items that should not be reduced. An example would be to log actions and translate them into a chart to visualize the distribution of actions outside of RLlib. This class will check if logged items are GPU tensors. If they are, they will be converted to CPU memory. Note that at the root level, the internal item list can grow to `window * len(incoming_stats)`. item_seriesNwindowctj|i|||_g|_|gdSN)super__init___windowitems _set_items)selfrargskwargs __class__s }/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/metrics/stats/item_series.pyrzItemSeriesStats.__init__sE$)&))) 35  cj|jr$|jrt||j|_dS||_dS)N)maxlen)ris_leafrr)r new_itemss rrzItemSeriesStats._set_items"s> < #DL #y>>>DJJJ#DJJJrreturncpt}|j|d<|j|d<|SNrr)r get_staterrrstaters rr%zItemSeriesStats.get_state,s3!!##g,h rr'c~t||d|_|d|_dSr$)r set_staterrr&s rr)zItemSeriesStats.set_state2s5 %   7^ X ritemc|j||jr8t|j|jkr|jdSdSdS)zPushes a item into this Stats object. This method does not handle GPU tensors. Args: item: The item to push. Can be of any type but data should be in CPU memory. N)rappendrlenpopleft)rr*s rpushzItemSeriesStats.push7sb $ < !C OOdl:: J    ! !::rTcompilec|j}|gt|}|r|S|}|||S)a#Reduces the internal values list according to the constructor settings. Args: compile: Argument is ignored for ItemSeriesStats. Returns: The reduced value (can be of any type, depending on the input values and reduction method). )rrr clone)rr0r return_statss rreducezItemSeriesStats.reduceCs^  #E**  Lzz|| &&&rc*t|jS)z.Returns the length of the internal items list.)r-rrs r__len__zItemSeriesStats.__len__Ys4:rFlatest_merged_onlyc|r|jrtd|r|j|r tjSgS|j}n|j}t |}|rt|dkr tjS|S)aRReturns the internal items list. This does not alter the internal items list. Args: compile: If True and items list is empty, returns np.nan. Otherwise returns the items list. latest_merged_only: If True, only considers the latest merged values. This parameter only works on aggregation stats (root or intermediate nodes). When enabled, peek() will only use the items from the most recent merge operation. Returns: The internal items list, or np.nan if compile=True and items list is empty. zPlatest_merged_only can only be used on aggregation stats objects (is_leaf=False)Nr)r ValueError latest_mergednpnanrr r-)rr0r8rs rpeekzItemSeriesStats.peek]s"  $, "   !)"6M &EEJE#E**  s5zzQ6M rincoming_statsc|jr Jdd|D}ttj|}t|j|z}||_|js ||_dSdS)zMerges ItemSeriesStats objects. Args: incoming_stats: The list of ItemSeriesStats objects to merge. Returns: None. The merge operation modifies self in place. zRItemSeriesStats should only be merged at aggregation stages (root or intermediate)cg|] }|j S)r).0ss r z)ItemSeriesStats.merge..s555QW555rN)r listr from_iterablerr;)rr?r! all_itemss rmergezItemSeriesStats.merges  ` ` _ ` ` 65n555 ,Y7788 $$y0  | +!*D    + +rcptj||}|i|d|diS| i|d|jiS|S)z;Returns the initialization arguments for this Stats object.) stats_objectr'Nr)r _get_init_argsr)rKr' super_argss rrLzItemSeriesStats._get_init_argssx-rI staticmethodrLrP __classcell__)rs@rrr s  )x} ###4S> 'tCH~'$'''''' ! ! ! ! ! !deC9J4J.K, @E***8<* tCy#~ ****X+D):$;+++++.  c3h   \ J#JJJJJJJJrr) collectionsr itertoolsrtypingrrrrr numpyr<"ray.rllib.utils.metrics.stats.baser #ray.rllib.utils.metrics.stats.utilsr ray.util.annotationsr rrBrrrbs33333333333333888888CCCCCC------dJdJdJdJdJidJdJdJdJdJr