&`io+ddlZddlZddlZddlZddlmZddlmZddlm Z m Z m Z m Z m Z mZddlZddlZddlZddlmZddlmZmZmZddlmZejeZeed Gd d ZdS) N) dataclass)Path)AnyDictListOptionalTupleUnionunflattened_lookup)EXPR_ERROR_PICKLE_FILEEXPR_PROGRESS_FILEEXPR_RESULT_FILE) PublicAPIstable stabilitycjeZdZUdZeeeefed<eded<ee ed<eed<dZ eded <dZ ee e deeeffed <dZeejjed <gd Zed eeeeffdZed ejjfdZdded efdZd efdZedejjded efdZe ddeeejfdeejjd dfdZe ddeded edfdZ!dS)Resulta{The final result of a ML training run or a Tune trial. This is the output produced by ``Trainer.fit``. ``Tuner.fit`` outputs a :class:`~ray.tune.ResultGrid` that is a collection of ``Result`` objects. This API is the recommended way to access the outputs such as: - checkpoints (``Result.checkpoint``) - the history of reported metrics (``Result.metrics_dataframe``, ``Result.metrics``) - errors encountered during a training run (``Result.error``) The constructor is a private API -- use ``Result.from_path`` to create a result object from a directory. Attributes: metrics: The latest set of reported metrics. checkpoint: The latest checkpoint. error: The execution error of the Trainable run, if the trial finishes in error. path: Path pointing to the result directory on persistent storage. This can point to a remote storage location (e.g. S3) or to a local location (path on the head node). The path is accessible via the result's associated `filesystem`. For instance, for a result stored in S3 at ``s3://bucket/location``, ``path`` will have the value ``bucket/location``. metrics_dataframe: The full result dataframe of the Trainable. The dataframe is indexed by iterations and contains reported metrics. Note that the dataframe columns are indexed with the *flattened* keys of reported metrics, so the format of this dataframe may be slightly different than ``Result.metrics``, which is an unflattened dict of the latest set of reported metrics. best_checkpoints: A list of tuples of the best checkpoints and their associated metrics. The number of saved checkpoints is determined by :class:`~ray.train.CheckpointConfig` (by default, all checkpoints will be saved). metricszray.tune.Checkpoint checkpointerrorpathNz pd.DataFramemetrics_dataframebest_checkpoints_storage_filesystem)rrr filesystemrreturncJ|jsdS|jddS)z&The config associated with the result.Nconfig)rgetselfs b/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/air/result.pyr z Result.configIs+| 4|$///cL|jptjS)zReturn the filesystem that can be used to access the result path. Returns: pyarrow.fs.FileSystem implementation. )rpyarrowfsLocalFileSystemr"s r$rzResult.filesystemPs 'G7:+E+E+G+GGr%rindentcT ddlm}ddlm}fdjD}jrt jj|d<n|d|dj |d<j rLt| |fdj D|d<d |z}d |d zz fd | D}d |}d |t j|S)zCConstruct the representation with specified number of space indent.r)BLACKLISTED_KEYS)AUTO_RESULT_KEYSc2i|]}|t|S)getattr).0kr#s r$ z Result._repr..^s%MMMAAwtQ//MMMr%rrc$i|] \}}|v || Sr/r/)r1r2vexcludes r$r3z Result._repr..is0+++A'9I9I19I9I9Ir%r c(g|]\}}|d|S)=r/)r1keyvalue kws_indents r$ z Result._repr..ps=   /9sEz *3 * * * *   r%z, z{0}{1}( {2} {0}))ray.tune.experimental.outputr,ray.tune.resultr-_items_to_reprrtype__name__pop type_namersetupdateitemsjoinformat) r#r*r,r-shown_attributes cls_indentkwskws_reprr6r=s ` @@r$_reprz Result._reprYsxAAAAAA444444MMMM9LMMM : *(,TZ(8(8(A W % %   ) ) ))9,)G)Q& < *++G NN+ , , ,++++!%!3!3!5!5+++ Y '6\ FQJ'     =M=S=S=U=U   ::c??#**:tDzz7JHUUUr%c.|dS)Nr)r*)rOr"s r$__repr__zResult.__repr__vszzz###r%storage_filesystem storage_pathc||5}|cdddS#1swxYwYdS)aOpens a file as an input stream reading all byte content sequentially and decoding read bytes as utf-8 string. Args: storage_filesystem: The filesystem to use. storage_path: The source to open for reading. N)open_input_streamreadalldecode)rRrSfs r$_read_file_as_strzResult._read_file_as_strys 1 1, ? ? (199;;%%'' ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( ( (s&A  A A c ddlmddlm}m}m}ddlm}|||\|stddtt }tt }||rX| |d} d| D} tj| d } | r| d ni} n||rctjt%j| |} | js| jd ni} n td td tdt/|d} | rfd| D}g}| D]t}| | ||k}|jrt0d|d||jrin|jd u|d }t7t9||}ndx}}d}tt: }||rL|5}t>j !|}dddn #1swxYwYtE| || ||S)a3Restore a Result object from local or remote trial directory. Args: path: A path of a trial directory on local or remote storage (ex: s3://bucket/path or /tmp/ray_results). storage_filesystem: A custom filesystem to use. If not provided, this will be auto-resolved by pyarrow. If provided, the path is assumed to be prefix-stripped already, and must be a valid path on the filesystem. Returns: A :py:class:`Result` object of that trial. r) Checkpoint)_exists_at_fs_path_list_at_fs_pathget_fs_and_path)CHECKPOINT_DIR_NAMEz Trial folder z doesn't exist! c:g|]}|tj|Sr/)jsonloads)r1lines r$r>z$Result.from_path..s'DDDdtDD))DDDr%/)sepz-Failed to restore the Result object: Neither z nor z exists in the trial folder!ct|jtjjjko|jdS)N checkpoint_)rBr'r(FileType Directory base_name startswith) file_infos r$z"Result.from_path..s5in:&0/1/B'22=AAr%) file_filtercjg|]/}t|0S))rr)ras_posix)r1checkpoint_dir_namer[r(fs_paths r$r>z$Result.from_path..sY( g':;;DDFFSUr%z(Could not find metrics corresponding to z&. These will default to an empty dict.N)rrrrrrr)# ray.trainr[ray.train._internal.storager\r]r^ray.train.constantsr_ RuntimeErrorrrrrrrYsplitpdjson_normalizeread_csvioStringIOemptyilocto_dictsortedloggerwarningappendlistzipr rUray cloudpickleloadr)clsrrRr\r]r^r_result_json_fileprogress_csv_filelines json_list metrics_dflatest_metricscheckpoint_dir_names checkpointsrrs#metrics_corresponding_to_checkpointlatest_checkpointrrerror_file_pathrXr[r(rts @@@r$ from_pathzResult.from_pathsH( )(((((          <;;;;;%od,>?? G!!"g.. IGwGGGHH H )9::CCEE *<==FFHH  b"2 3 3 ))".>??EEdKKEDDeDDDI*9#>>>J.7?Yr]]RNN  $5 6 6  C11"6GHHIIJ6@5EM #++---2 NI@PII*III  &  BB       8,@ KG';  #6@237JJ737<NNW.WWW:@PBB<A"EMMOO !,B  $C W$=$=>>  37 7 0w(>??HHJJ  b/ 2 2 0%%o66 0!,,Q// 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0"( "(-    s$ KKKalpharmetricmodec6|jstd|dvrtd|d|dkrtnt}fd|jD}|s-tdd|jd ||fd  d S) aGet the best checkpoint from this trial based on a specific metric. Any checkpoints without an associated metric value will be filtered out. Args: metric: The key for checkpoints to order on. mode: One of ["min", "max"]. Returns: :class:`Checkpoint ` object, or None if there is no valid checkpoint associated with the metric. z,No checkpoint exists in the trial directory!)maxminzUnsupported mode: z$. Please choose from ["min", "max"]!rcDg|]}t|dd|S)N)defaultr )r1 ckpt_infors r$r>z.Result.get_best_checkpoint..s<   !&)A,EEEQ QQQr%zInvalid metric name z-! You may choose from the following metrics: .c0t|dS)Nrr )xrs r$roz,Result.get_best_checkpoint..s3EfaPQd3S3Sr%)r;r)rrx ValueErrorrrrkeys)r#rropvalid_checkpointss ` r$get_best_checkpointzResult.get_best_checkpoints $ OMNN N ~ % %OTOOO EMMSSs    !2    ! UvUU>Bl>O>O>Q>QUUU  r#)S)S)S)STTTUVWWr%)r)N)"rC __module__ __qualname____doc__rrstrr__annotations__ Exceptionrrrr rr'r( FileSystemrApropertyr rintrOrQ staticmethodrY classmethodr osPathLikerrrr/r%r$rrs!!Fd38n %%%%.//// I  III26x/666 h U($sCx.8 9:   <@'*"78???MMMN 0c3h0000X0 HGJ1HHHXHVVCVVVVV:$#$$$$ (#J1 ( (  ( ( (\ (?Cn n C$%n %WZ%:;n   n n n [n `Y!!!$X$X!$$X ' ($X$X$X"!$X$X$Xr%r)r}rbloggingr dataclassesrpathlibrtypingrrrrr r pandasrzr'rray._private.dictr ray.air.constantsr rrray.util.annotationsr getLoggerrCrrr/r%r$rso  !!!!!!:::::::::::::::: 000000 +*****  8 $ $  XEXEXEXEXEXEXEX EXEXEXr%