&`ib*dZddlZddlmZmZddlZddlZddl Z ddl m Z ddl m Z mZddlmZddlmZerddlmZejeZe dd ZddZddZddZdZ ddZdZdZdS)z,Common pre-checks for all RLlib experiments.N) TYPE_CHECKINGSet) DeveloperAPI)ERR_MSG_OLD_GYM_APIUnsupportedSpaceException)get_base_struct_from_space)log_once MultiAgentEnvenvr returnc,ddlm}t|stdt dr t drt ds/t drt dd d S d i }n5#t$r(}ttj d |d }~wwxYw|\}}t|dfd| D}t|d |}n5#t$r(}ttj d|d }~wwxYw|\}} } } } t|dt| dt| dt| dt| ddtd| idjt#d| id| idjt%d| idjd S)zgChecking for common errors in RLlib MultiAgentEnvs. Args: env: The env to be checked. rr z&The passed env is not a MultiAgentEnv.observation_space action_space _agent_idsma_env_super_ctor_calledzYour MultiAgentEnv z does not have some or all of the needed base-class attributes! Make sure you call `super().__init__()` from within your MutiAgentEnv's constructor. This will raise an error in the future.N*)seedoptionsz7In particular, the `reset()` method seems to be faulty.zreset()c`i|]*}||+S)get_action_spacesample).0aidr s r/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/rllib/utils/pre_checks/env.py z1check_multiagent_environments..9sB47S ! !# & & - - / /z&get_action_space(agent_id=..).sample()z6In particular, the `step()` method seems to be faulty.zstep, next_obsz step, rewardz step, donezstep, truncatedz step, infoT) allow_common dummy_env_id)base_env agent_ids) ray.rllib.envr isinstance ValueErrorhasattrr loggerwarningreset Exceptionrformat"_check_if_element_multi_agent_dictkeysstep _check_rewardagents_check_done_and_truncated _check_info) r r obs_and_infose reset_obs reset_infossampled_actionresultsnext_obsrewarddone truncatedinfos ` rcheck_multiagent_environmentsr>s,+++++ c= ) )ABBB())  C ( (  C & &  . / /  NN:c:::     r2 66   &N       +I{&sIyAAA;D>>;K;KN' ^E((>**   &M       /6+HfdIt&sH6FGGG&sFNCCC&sD,???&sI7HIII&sD,TRRRR>6*TSZPPPP  #*  &LLLLLLs0B C)#C  CD22 E$<#EE$Fc|r|D]\}}|D]\}}tj|rNt|ts9tj|sIt|tjr |jdks$d|dt|}t|||vs|dksd|}t|dStj|rNt|ts9tj|sVt|tjr |jdks3d t|}t|dSdS)NrzJYour step function must return rewards that are integer or float. reward: z. Instead it was a __all__zrYour reward dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: zUYour step function must return a reward that is integer or float. Instead it was a {}) itemsnpisrealr$boolisscalarndarrayshapetyper%r+)r:r!r"_multi_agent_dictagent_idrewerrors rr/r/Ys$ #)<<>> , , A!1!7!7!9!9 , , #IcNN ,&sD11 , C(( , 'sBJ77 , =@IOO'69''99'' %U+++ I--Y1F1F7+477 %U++++ , , ,0 &  64((   K    62:..  4:<23E3E ""(&f"6"6    4F3Erc dD]}|dkr|n|}|r|D]\}}|D]i\}} t| ttjfs"t d|dt |||vs|dksd|d|} t | jt|ttjfs$d|d t |} t | dS) N)r;r<r;z Your step function must return `z's` that are boolean. But instead was a r@zYour `zis` dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: z"Your step function must return a `z'` that is a boolean. But instead was a )rAr$rDrBbool_r%rH) r;r<r!r"whatdatarIrJrKdone_rMs rr1r1sr%$$v~~tt9  $'+zz|| 0 0##'7'='='?'? 0 0OHe%edBH-=>>(GtGG:>t**GG% 11X5J5J;T;;/8;; )/// 0 0D4"233 $.T..!%d.. U## #  $#$$rc|r|D]z\}}|D]`\}}t|ts"tdt |d|||vs |dks|dksd|}t|a{dSt|ts$dt |d|}t|dS)NzDYour step function must return infos that are a dict. instead was a z : element: r@ __common__zqYour dones dictionary must have agent ids that belong to the environment. AgentIDs received from env.agents are: zDYour step function must return a info that is a dict. element type: z . element: )rAr$dictr%rH)r=r!r"rIrJrKinfrMs rr2r2sK #'::<< , , A!1!7!7!9!9 , , #!#t,,$E)-cEE?BEE  ))9,,<//7+477 %U+++! , , ,$d # #  F(,T  F F?C F F    rc 0d|d|d|d|d|d|d }|S)NzThe z collected from z% was not contained within your env's z@ space. Its possible that there was a typemismatch (for example z)s of np.float32 and a space ofnp.float64 zs), or that one of the sub-zs wasout of boundsr) func_name_type_errors r_not_contained_errorr[sh u  i    !&    9>     MrcBt|ts<|rd|dt|}nd|dt|}t|t |jd|rdtfd|Dsq|r0d|dt| d|j}n0d|d t| d|jd }t|dS) NzThe element returned by zJ contains values that are not MultiAgentDicts. Instead, they are of type: z3 is not a MultiAgentDict. Instead, it is of type: r@rTc3 K|]}|vV dSNr)rkr"s r z5_check_if_element_multi_agent_dict..s'//!qI~//////rz_ has agent_ids that are not the names of the agents in the env.agent_ids in this MultiEnvDict: z AgentIDs in this env: zb has agent_ids that are not the names of the agents in the env. AgentIDs in this MultiAgentDict: z. You likely need to add the attribute `agents` to your env, which is a list containing the IDs of agents currently in your env/episode, as well as, `possible_agents`, which is a list of all possible agents that could ever show up in your env.) r$rUrHr%setr0addalllistr-)r elementfunction_stringr!rrMr"s @rr,r,s gt $ $   )?))g)) E$?$$MM$$  __I MM)$ l### ////w/// / /   ?  ((  :    EH?HH ''HH: HHH )  rct|tjjtjjfsd||j|t |fSt|}d} tj |||nz#t$rm}|j dd|j dd}}d |j dd||j|t |fcYd}~Sd}~wwxYwdS)aCReturns error, value, and space when offending `space.contains(value)` fails. Returns only the offending sub-value/sub-space in case `space` is a complex Tuple or Dict space. Args: space: The gym.Space to check. value: The actual (numpy) value to check for matching `space`. Returns: Tuple consisting of 1) key-sequence of the offending sub-space or the empty string if `space` is not complex (Tuple or Dict), 2) the offending sub-space, 3) the offending sub-space's dtype, 4) the offending sub-value, 5) the offending sub-value's dtype. .. testcode:: :skipif: True path, space, space_dtype, value, value_dtype = _find_offending_sub_space( gym.spaces.Dict({ -2.0, 1.5, (2, ), np.int8), np.array([-1.5, 3.0]) ) NcT||st|||fdSr^)containsr)psvs rmap_fnz)_find_offending_sub_space..map_fns2zz!}} 7+Q1I66 6 7 7rrz->)NNNNN) r$gymspacesDictTupledtype _get_typertreemap_structure_with_pathrargsjoin)spacevaluestructured_spacermr4s r_find_offending_sub_spacer}s2 ecjosz/?@ A AAUEK %0@0@@@1%88777T $V-=uEEEE $TTTvay|QVAYq\uyy1&&u{E9UCSCSSSSSSSST ( 'sA44 C+>A"C& C+&C+cNt|dr|jnt|S)Nrt)r&rtrH)vars rrurus#W-- <399499r/r1r2r[r,r}rurrrrs22%%%%%%%% 444444PPPPPPPPIIIIII,++++++  8 $ $AMAMAMAMH% % % % P$$$$4    8 . . . . b)()()(X=====r