&`izddlZddlmZmZmZmZddlmZddl Z ddl m Z ddl m Z GddeZe d Gd d eZdS) N)DictListOptionalUnion)Callback)TensorflowCheckpoint) PublicAPIceZdZdZgdZddeeeefffd Zde defdZ dd Z dd Z dd Z dd ZddZddZddZddZddZddZddZddZddZddZxZS) _Callbackz%Base class for Air's Keras callbacks.) epoch_begin epoch_endtrain_batch_begintrain_batch_endtest_batch_begintest_batch_endpredict_batch_beginpredict_batch_end train_begin train_end test_begintest_end predict_begin predict_endvalidation_endoncttt|ts|g}t fd|Dr(t d|j|_ dS)Nc3*K|] }|jvVdSN)_allowed).0wselfs n/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/air/integrations/keras.py z%_Callback.__init__..$s*22!q %222222z4Invalid trigger time selected: {}. Must be one of {}) superr __init__ isinstancelistany ValueErrorformatr_on)r"r __class__s` r#r'z_Callback.__init__s i'')))"d## B 2222r222 2 2 FMM   r%logswhenctr)NotImplementedError)r"r/r0s r#_handlez_Callback._handle,s!!r%NcHd|jvr||ddSdS)Nr r-r3r"epochr/s r#on_epoch_beginz_Callback.on_epoch_begin/1 DH $ $ LL} - - - - - % $r%cHd|jvr||ddSdS)Nr r5r6s r# on_epoch_endz_Callback.on_epoch_end31 $( " " LL{ + + + + + # "r%cHd|jvr||ddSdS)Nrr5r"batchr/s r#on_train_batch_beginz_Callback.on_train_batch_begin72 $( * * LL2 3 3 3 3 3 + *r%cHd|jvr||ddSdS)Nrr5r>s r#on_train_batch_endz_Callback.on_train_batch_end;s2  ( ( LL0 1 1 1 1 1 ) (r%cHd|jvr||ddSdS)Nrr5r>s r#on_test_batch_beginz_Callback.on_test_batch_begin?s2  ) ) LL1 2 2 2 2 2 * )r%cHd|jvr||ddSdS)Nrr5r>s r#on_test_batch_endz_Callback.on_test_batch_endCs2 tx ' ' LL/ 0 0 0 0 0 ( 'r%cHd|jvr||ddSdS)Nrr5r>s r#on_predict_batch_beginz _Callback.on_predict_batch_beginGs2 DH , , LL4 5 5 5 5 5 - ,r%cHd|jvr||ddSdS)Nrr5r>s r#on_predict_batch_endz_Callback.on_predict_batch_endKrAr%cHd|jvr||ddSdS)Nrr5r"r/s r#on_train_beginz_Callback.on_train_beginOr9r%cHd|jvr||ddSdS)Nrr5rMs r# on_train_endz_Callback.on_train_endSr<r%cHd|jvr||ddSdS)Nrr5rMs r# on_test_beginz_Callback.on_test_beginWs1 48 # # LL| , , , , , $ #r%cHd|jvr||ddSdS)Nrr5rMs r# on_test_endz_Callback.on_test_end[s1  ! ! LLz * * * * * " !r%cHd|jvr||ddSdS)Nrr5rMs r#on_predict_beginz_Callback.on_predict_begin_s1 dh & & LL / / / / / ' &r%cHd|jvr||ddSdS)Nrr5rMs r#on_predict_endz_Callback.on_predict_endcr9r%)rr)__name__ __module__ __qualname____doc__rrstrrr'rr3r8r;r@rCrErGrIrKrNrPrRrTrVrX __classcell__r.s@r#r r s//H"  5d3i0      "D"""""....,,,,444422223333111166664444....,,,,----++++0000........r%r alpha) stabilityc eZdZdZ d deeeefdeeeefdeeeeeeeeffffd Z ded efd Z ded efd Z xZ S)ReportCheckpointCallbackaKeras callback for Ray Train reporting and checkpointing. .. note:: Metrics are always reported with checkpoints, even if the event isn't specified in ``report_metrics_on``. Example: .. code-block:: python ############# Using it in TrainSession ############### from ray.air.integrations.keras import ReportCheckpointCallback def train_loop_per_worker(): strategy = tf.distribute.MultiWorkerMirroredStrategy() with strategy.scope(): model = build_model() model.fit(dataset_shard, callbacks=[ReportCheckpointCallback()]) Args: metrics: Metrics to report. If this is a list, each item describes the metric key reported to Keras, and it's reported under the same name. If this is a dict, each key is the name reported and the respective value is the metric key reported to Keras. If this is None, all Keras logs are reported. report_metrics_on: When to report metrics. Must be one of the Keras event hooks (less the ``on_``), e.g. "train_start" or "predict_end". Defaults to "epoch_end". checkpoint_on: When to save checkpoints. Must be one of the Keras event hooks (less the ``on_``), e.g. "train_start" or "predict_end". Defaults to "epoch_end". r N checkpoint_onreport_metrics_onmetricsct|tr|g}t|tr|g}tt||z}t |||_||_||_dS)N)r) r(r]r)setr&r'_checkpoint_on_report_metrics_on_metrics)r"rdrerfrr.s r#r'z!ReportCheckpointCallback.__init__s mS ) ) ,*OM ' - - 4!2 3  #m&7788 9 9 B)6-> r%r/r0c^||jvs ||jvsJ||}||jv}|rWtj|j}t j||tj |j ddSt j|ddS)N) checkpointT) ignore_errors) rirj_get_reported_metricsr from_modelmodelraytrainreportshutilrmtreepath)r"r/r0rfshould_checkpointrms r#r3z ReportCheckpointCallback._handlest***dd6M.M.M.MM,,T22 D$77  7-8DDJ I  W  < < < M*/ > > > > > > I  W  6 6 6 6 6r%returnct|jtdttt fsJ|j}nt|jtr|j|ji}nmt|jtrfd|jD}n?t|jt r%fd|jD}t|t sJ|S)Nc"i|] }|| Sr|)r metricr/s r# zBReportCheckpointCallback._get_reported_metrics..sQQQV QQQr%c(i|]\}}||Sr|r|)r keyr}r/s r#r~zBReportCheckpointCallback._get_reported_metrics..s0   &1c6T&\   r%)r(rktyper]r)dictitems)r"r/reported_metricss ` r#roz.ReportCheckpointCallback._get_reported_metricss$-$t**c4)FGGGGG = #    s + +  $ tDM/BC    t , , QQQQ4=QQQ    t , ,     59]5H5H5J5J    *D11111r%)r r N) rYrZr[r\rr]rrrr'r3ror^r_s@r#rcrchsD0;3>CG   S$s)^, !d3i0 %T#YS#X >?@       $ 7D 7 7 7 7 7 $ 4        r%rc)rutypingrrrrtensorflow.keras.callbacksr KerasCallbackrrray.train.tensorflowrray.util.annotationsr r rcr|r%r#rs ............@@@@@@ 555555******Z.Z.Z.Z.Z. Z.Z.Z.z WP P P P P yP P P P P r%