&`i ddlZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z erddl mZejeZGddeej ZdS) N) TYPE_CHECKINGAnyUnion)FaultAwareApply) MetricsLogger) DeviceType TensorType)AlgorithmConfigc~eZdZdfd ZejdZejdZejdefdZ ejdefdZ ejdd Z e ejde ed ffd Zejdd Zejdd ZejdefdZxZS)Runnerconfigr c F|d|_|d|_||d|_t|jd|_ t dS)zInitializes a `Runner` instance. Args: config: The `AlgorithmConfig` to use to setup this `Runner`. **kwargs: Forward compatibility `kwargs`. worker_indexF) copy_frozenr)stats_cls_lookuprootN) getrcopyr set_device make_module_weights_seq_norrmetricssuper__init__)selfr kwargs __class__s r/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/runners/runner.pyrzRunner.__init__s"(N!;!;'-{{u{'E'E    '4#4' ' '  cdS)aDChecks that self.__init__() has been completed properly. Useful in case an `Runner` is run as @ray.remote (Actor) and the owner would like to make sure the Ray Actor has been properly initialized. Raises: AssertionError: If the `Runner` Actor has NOT been properly initialized. Nrs rassert_healthyzRunner.assert_healthy(rcdS)a*Creates the `RLModule` for this `Runner` and assigns it to `self.module`. Note that users should be able to change the `Runner`'s config (e.g. change `self.config.rl_module_spec`) and then call this method to create a new `RLModule` with the updated configuration. Nr!r"s rrzRunner.make_module3s  rreturnc dS)zRuns the `Runner`. The exact logic of this method could have very different forms. Args: **kwargs: Forward compatibility kwargs. Returns: Anything. Nr!)rrs rrunz Runner.run=r$rcdS)z|Returns metrics (in any form) of the logic run in this `Runner`. Returns: Metrics of any form. Nr!r"s r get_metricszRunner.get_metricsJr$rNcdS)zReleases all resources used by this `Runner`. For example, when using a `gym.Env` in this `Runner`, you should make sure that its `close()` method is called. Nr!r"s rstopz Runner.stopRr$rcdS)zHReturns the device of this `Runner`. None if framework is not supported.Nr!r"s r_devicezRunner._deviceZs  rcdS)z"Sets the device for this `Runner`.Nr!r"s rrzRunner.set_device`s  rcdS)z:If this Actor is deleted, clears all resources used by it.Nr!r"s r__del__zRunner.__del__er$rcdS)z0Converts structs to a framework-specific tensor.Nr!)rstructs r_convert_to_tensorzRunner._convert_to_tensorir$r)r r )r&N)__name__ __module__ __qualname__rabcabstractmethodr#rrr(r*r,propertyrrr.rr1r r4 __classcell__)rs@rr r s0           s        S          z4/0   X       IIII ?J????????rr ) metaclass)r8loggingtypingrrrray.rllib.utils.actor_managerr&ray.rllib.utils.metrics.metrics_loggerrray.rllib.utils.typingrr %ray.rllib.algorithms.algorithm_configr getLoggerr5loggerABCMetar r!rrrFs ,,,,,,,,,,999999@@@@@@99999999FEEEEEE  8 $ $\?\?\?\?\?_ \?\?\?\?\?\?r