&`iddlmZddlmZmZmZddlZddlm Z m Z ddl m Z e \Z Ze \ZZZe dZe dZe deeeefd eefd ZdS) )deque)AnyListUnionN) try_import_tftry_import_torch) DeveloperAPIc tr4t|rt|Str9t|rtj|St j|S)zCheck if a value is NaN. Args: value: The value to check. Returns: True if the value is NaN, False otherwise. )torch is_tensorisnantfmathis_nannpvalues w/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/metrics/stats/utils.py safe_isnanr sn "''"{{5!!! %bll5!!%w~~e$$$ 8E??c"trRt|tjr8|St r.t |r|S|S)zConvert a single value to CPU if it's a tensor. TensorFlow tensors are always converted to numpy/python values. PyTorch tensors are converted to python scalars. ) r isinstanceTensordetachcpuitemrr numpyrs rsingle_value_to_cpurss E5<00||~~!!##((***  U##{{}} Lrvaluesreturnc8|sgStrt|dtjratt |}|}|St |S)aConvert a list or deque of GPU tensors to CPU scalars in a single operation. This function efficiently processes multiple PyTorch GPU tensors together by stacking them and performing a single .cpu() call. Assumes all values are either PyTorch tensors (on same device) or already CPU values. Args: values: A list or deque of values that may be GPU tensors. Returns: A list of CPU scalar values. r)r rrstacklistrrtolist)rstacked cpu_tensors rbatch_values_to_cpur',s   #F1Iu|44#++d6ll++^^%%))++   """ <<r) collectionsrtypingrrrrrray.rllib.utils.frameworkrrray.util.annotationsr r _rrrr'rrr.s##########EEEEEEEE------    q =??2q       d3i&6 7DIr