&`i#ddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z ddl m Z mZer ddlmZddlmZddlmZddlmZdd lmZmZhd Zhd Zhd Zd dhZhdZGddeZde de e fdZ!d+dZ"dZ#de d fdZ$d,dZ%dZ&dZ'd e ed!d"ee e(ffd#Z)d e ed!d"e*fd$Z+d-d'Z,d"e*fd(Z-d)ed"dfd*Z.dS).N)Enum) TYPE_CHECKINGDictListOptionalSetUnion)TagKeyrecord_extra_usage_tag)StorageContext BaseTrainerCallbackTrialSchedulerBasicVariantGeneratorSearcher> TorchTrainerHorovodTrainerXGBoostTrainerLightGBMTrainerTensorflowTrainer> JaxTrainerrrrrDataParallelTrainer>AxSearchTuneBOHB HEBOSearch ZOOptSearch OptunaSearchBayesOptSearchHyperOptSearchNevergradSearchConcurrencyLimiterRepeater> PB2 FIFOSchedulerHyperBandForBOHBHyperBandSchedulerMedianStoppingRuleAsyncHyperBandSchedulerPopulationBasedTrainingResourceChangingSchedulerPopulationBasedTrainingReplayceZdZdZdZdZdZdS) AirEntrypointz Tuner.fitz Trainer.fitztune.runztune.run_experimentsN)__name__ __module__ __qualname__TUNERTRAINERTUNE_RUNTUNE_RUN_EXPERIMENTSk/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/air/_internal/usage.pyr1r1Cs% EGH1r:r1allowed_module_path_prefix whitelistcb|j}|jj}||r||vr|SdS)aFind the class name of the object. If the object is not under `allowed_module_path_prefix` or if its class is not in the whitelist, return "Custom". Args: obj: The object under inspection. allowed_module_path_prefix: If the `obj`'s class is not under the `allowed_module_path_prefix`, its class name will be anonymized. whitelist: If the `obj`'s class is not in the `whitelist`, it will be anonymized. Returns: The class name to be tagged with telemetry. Custom)r3 __class__r2 startswith)objr<r= module_pathcls_names r;_find_class_namerEJs@.K}%H899h)>S>Sxr:trainerrcddlm}t||sJt|dt}t t j|dS)Nrr ray.train)ray.train.trainerr isinstancerE AIR_TRAINERSr r AIR_TRAINER)rFr trainer_names r;tag_air_trainerrN`sT------ g{ + +++ +#G[,GGL6-|<<<<>>>>r:searchercHddlm}m}t||rt t jddSt||rUt|dt t}|tvrdSt t j|dSJd)Nrrrzray.tune.searchFzZNot expecting a non-BasicVariantGenerator, non-Searcher type passed in for `tag_searcher`.) ray.tune.searchrrrJr r TUNE_SEARCHERrETUNE_SEARCHERSunionTUNE_SEARCHER_WRAPPERS)rTrr searcher_names r; tag_searcherr\ps????????(122  v35LMMMMM Hh ' '  ( ')=)=>T)U)U   2 2 2 Fv3]CCCCC  >  ur: schedulerrcddlm}t||sJt|dt}t t j|dS)Nrrzray.tune.schedulers)ray.tune.schedulersrrJrETUNE_SCHEDULERSr r TUNE_SCHEDULER)r]rscheduler_names r; tag_schedulerrcsU222222 i 0 000 0%i1FXXN60.AAAAAr:c:ttjddSN1)r r AIR_SETUP_WANDB_INTEGRATION_USEDr9r:r;tag_setup_wandbrhs6BCHHHHHr:c:ttjddSre)r r !AIR_SETUP_MLFLOW_INTEGRATION_USEDr9r:r;tag_setup_mlflowrks6CSIIIIIr: callbacksrreturncddlm}ddlm}ddlm}ddlm}ddlm }ddl m }ddl m }||||f|z}d |D} tjt } |pg}|D]e} t#| |s| jj} | | vr| | xxd z cc<4t#| |r| d xxd z cc<U| d xxd z cc<f| S) zHCreates a map of callback class name -> count given a list of callbacks.r)CometLoggerCallback)MLflowLoggerCallback)WandbLoggerCallbackr)LoggerCallback)AimLoggerCallback)DEFAULT_CALLBACK_CLASSEScg|] }|j Sr9)r2).0 callback_clss r; z$_count_callbacks..sSSS l+SSSr:CustomLoggerCallbackCustomCallback)ray.air.integrations.cometroray.air.integrations.mlflowrpray.air.integrations.wandbrqray.tunerray.tune.loggerrrray.tune.logger.aimrsray.tune.utils.callbackrt collections defaultdictintrJr@r2) rlrorprqrrrrsrtbuilt_in_callbackscallback_namescallback_countscallback callback_names r;_count_callbacksrs>>>>>>@@@@@@>>>>>>!!!!!!......555555@@@@@@   ! !TS@RSSSN!-c22ORI 3 3(H--   *3 N * * M * * *a / * * * * . 1 1 3 2 3 3 3q 8 3 3 3 3 , - - - 2 - - - - r:c|sdSt|}|r0tj|}ttj|dSdS)aRecords built-in callback usage via a JSON str representing a dictionary mapping callback class name -> counts. User-defined callbacks will increment the count under the `CustomLoggerCallback` or `CustomCallback` key depending on which of the provided interfaces they subclass. NOTE: This will NOT track the name of the user-defined callback, nor its implementation. This will NOT report telemetry if no callbacks are provided by the user. Returns: bool: True if usage was recorded, False otherwise. FN)rjsondumpsr r AIR_CALLBACKS)rlrcallback_counts_strs r; tag_callbacksrs] u&y11OJ"j99v35HIIIIIJJr:storager chd}|jrd}n|jj|vr |jj}nd}ttj|dS)aRecords the storage configuration of an experiment. The storage configuration is set by `RunConfig(storage_path, storage_filesystem)`. The possible storage types (defined by `pyarrow.fs.FileSystem.type_name`) are: - 'local' = pyarrow.fs.LocalFileSystem. This includes NFS usage. - 'mock' = pyarrow.fs._MockFileSystem. This is used for testing. - ('s3', 'gcs', 'abfs', 'hdfs'): Various remote storage schemes with default implementations in pyarrow. - 'custom' = All other storage schemes, which includes ALL cases where a custom `storage_filesystem` is provided. - 'other' = catches any other cases not explicitly handled above. >s3gcsabfshdfsmocklocalcustomotherN)custom_fs_providedstorage_filesystem type_namer r AIR_STORAGE_CONFIGURATION)rr=storage_config_tags r;tag_storage_typersc?>>I!%%  # - : :$7A$6;=OPPPPPr:cBddlm}ddlm}ddlm}t t|||}g}|D]%}|tj vr| |&|r0tj |}ttj|dSdS)acRecords usage of environment variables exposed by the Ray AIR libraries. NOTE: This does not track the values of the environment variables, nor does this track environment variables not explicitly included in the `all_ray_air_env_vars` allow-list. Returns: bool: True if at least one environment var is supplied by the user. r) AIR_ENV_VARS)TRAIN_ENV_VARS) TUNE_ENV_VARSTF)ray.air.constantsrray.train.constantsrray.tune.constantsrsortedsetrYosenvironappendrrr r )rrrall_ray_air_env_varsuser_supplied_env_varsenv_var env_vars_strs r;tag_ray_air_env_varsrs/.....222222000000!  L-@@ '33 bj " ) )' 2 2 2z"899 v2LAAAt 5r: entrypointcZ|tvsJttj|jdS)z.Records the entrypoint to an AIR training run.N)r1r r AIR_ENTRYPOINTvalue)rs r;tag_air_entrypointrs/  & & & &60*2BCCCCCr:)rFr)r]r)rr )/rrrenumrtypingrrrrrr ray._common.usage.usage_libr r ray.train._internal.storager rIrrrr_rrVrrrKrQrXrZr`r1strrErNrSr\rcrhrkrrboolrrrrr9r:r;rs BBBBBBBBBBBBBBBBFFFFFFFF@::::::------!!!!!!222222????????       22222D222cc#h,====??? 5!DE    ,BBBBIIIJJJ#j)9 :#tCH~####LJXd:&67JDJJJJ2QQQQ4d@D=DTDDDDDDr: