&`iddlZddlZddlZddlmZmZddlmZddlm Z ddl m Z m Z ddl mZejeZe GddejZdS) N)AnyDict)Dataset)Policy) DeveloperAPIExperimentalAPI)SampleBatchTypec eZdZdZedefdZejede de e e ffdZ ede de e e ffdZeejdd ed ede e e ffd Zd S) OfflineEvaluatorz.Interface for an offline evaluator of a policypolicyc ||_dS)zInitializes an OffPolicyEstimator instance. Args: policy: Policy to evaluate. kwargs: forward compatibility placeholder. N)r )selfr kwargss w/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/offline/offline_evaluator.py__init__zOfflineEvaluator.__init__s batchreturnc t)aPReturns the evaluation results for the given batch of episodes. Args: batch: The batch to evaluate. kwargs: forward compatibility placeholder. Returns: The evaluation done on the given batch. The returned dict can be any arbitrary mapping of strings to metrics. )NotImplementedErrorrrrs restimatezOfflineEvaluator.estimates "!rc iS)a6Sometimes you need to train a model inside an evaluator. This method abstracts the training process. Args: batch: SampleBatch to train on kwargs: forward compatibility placeholder. Returns: Any optional metrics to return from the evaluator rs rtrainzOfflineEvaluator.train+s  r) n_parallelismdatasetrcdS)aCalculates the estimate of the metrics based on the given offline dataset. Typically, the dataset is passed through only once via n_parallel tasks in mini-batches to improve the run-time of metric estimation. Args: dataset: The ray dataset object to do offline evaluation on. n_parallelism: The number of parallelism to use for the computation. Returns: Dict[str, Any]: A dictionary of the estimated values. Nr)rrrs restimate_on_datasetz$OfflineEvaluator.estimate_on_dataset9srN)__name__ __module__ __qualname____doc__rrrabcabstractmethodr rstrrrrros cpu_countrintrrrrr r s88v\  "o "DcN " " "\ " ? c3h   \  *R\^^       c3h    _   rr )r$loggingr'typingrrray.datarray.rllib.policyrray.rllib.utils.annotationsrrray.rllib.utils.typingr getLoggerr loggerABCr rrrr3s  ######EEEEEEEE222222  8 $ $= = = = = sw= = = = = r