Pi!ddlmZddlmZddlmZddlmZmZm Z m Z ddl m Z m Z ddlmZddlmZmZded e d d fd Zd e eeefe fd efdZded efdZdede ed e fdZdeeefded d fdZd S)) Namespace) import_module) ModuleType)AnyDictListUnion) DictConfig OmegaConf)InstantiationError) get_logger log_rank_zero recipe_namecfgreturnNctd}tj|dd}t|d|d|dS)z Logs the resolved config (merged YAML file and CLI overrides) to rank zero. Args: recipe_name (str): name of the recipe to display cfg (DictConfig): parsed config object DEBUGT)resolve sort_keyszRunning z with resolved config: )loggermsgN)r r to_yamlr)rrrcfg_strs k/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchtune/config/_utils.py log_configrs_ FTTBBBGVkVVWVVnodec\tj|st|tod|vS)N _component_)r is_dict isinstancedict)rs r_has_componentr#!s-  d # # =z$'='= X=TXCXXrpathc  |dkrtdd|dD}|D]'}t|std|ddz(|d} t|}n<#t$r/}t d|d t |d |d z|d }~wwxYwtd t|D]1}||} t||}#t$r}d |d |}t|trd |d |d z} t| }Yd }~#t$r2}t d|d t |d|d|dz|d }~wt$r(}t d|d t ||d }~wwxYwt d|d t |d|d|dz|d }~wwxYw|S)aY Return an object by name or dotted path, importing as necessary. The base functionality relies on ``getattr()`` and handles all possible exceptions accordingly. Based on Hydra's `_locate` from Facebook Research: https://github.com/facebookresearch/hydra/blob/main/hydra/_internal/utils.py#L614 Args: path (str): Dotted path of the object Returns: Any: The object Raises: InstantiationError: If there is an exception loading the object from the provided path ValueError: If a relative or invalid dotpath is passed in z Empty pathcg|]}|Sr().0parts r z,_get_component_from_path..<s . . .dT . . .r.zError loading 'z': invalid dotstring.z$ Relative imports are not supported.rz': z Are you sure that module 'z' is installed?Nz Are you sure that 'z' is importable from module 'z'?z' is an attribute of ') ValueErrorsplitlenr ImportErrorr reprrangegetattrAttributeErrorjoinr!rModuleNotFoundError Exception) r$partsr*part0obj exc_importmexc_attrparent_dotpathmods r_get_component_from_pathrA%s( rzz&&& . .djjoo . . .E4yy =$===9:   !HEE""  :d : :Z(8(8 : :CUCCC D   1c%jj ! !Qx #t$$CC    XXeBQBi00N#z** &hhuWq1uW~.. &',,CHHHH*&&&,F$FFD4D4DFFg$ggUcgggh&& !&&&,F$FFD4D4DFF%&& %<$<>> config.yaml: >>> a: 1 >>> b: >>> _component_: torchtune.models.my_model >>> c: 3 >>> tune full_finetune --config config.yaml b=torchtune.models.other_model b.c=4 >>> yaml_args, cli_args = parser.parse_known_args() >>> conf = _merge_yaml_and_cli_args(yaml_args, cli_args) >>> print(conf) >>> {"a": 1, "b": {"_component_": "torchtune.models.other_model", "c": 4}} Args: yaml_args (Namespace): Namespace containing args from yaml file, components should have _component_ fields cli_args (List[str]): List of key=value strings Returns: DictConfig: OmegaConf DictConfig containing merged args Raises: ValueError: If a cli override is not in the form of key=value ~r-N=rr0Removing components from CLI is not supported: ~zCould not find key z in yaml config to removez=Command-line overrides must be in the form of key=value, got z ._component_Nonez!!null max_filenamez!!str ) vars startswithr/r._remove_key_by_dotpathKeyErrorr#appendr from_dotlistcreatemerge) rBrC yaml_kwargs cli_dotlistargdotpathkvcli_conf yaml_confs r_merge_yaml_and_cli_argsrZpsHy//KK$'$' >>#   !""gmmC((+G'' PwPP &{G<<<<j)    L'LLL   99S>>DAqq   UPSUU    {1~ > >   A ;;A Q  1 Aa::!::&&&&%k22H --I ?9h / //s&A77&B"B;;C nested_dictrUcd}dtttfdtddffd dtttfdttddffd ||dS) z Removes a key specified by dotpath from a nested dict. Errors should handled by the calling function. Args: nested_dict (Dict[str, Any]): Dict to remove key from dotpath (str): dotpath of key to remove, e.g., "a.b.c" r,dkeyrNc\t||rtd||=dS)NrG)r#r.)r]r^rUs rdelete_non_componentz4_remove_key_by_dotpath..delete_non_componentsA !C& ! ! L7LL  cFFFrr$ct|dkr||ddS||d|dd||ds||ddSdS)Nr-r)r0)r]r$r`recurse_and_deletes rrbz2_remove_key_by_dotpath..recurse_and_deletes t99>> DG , , , , ,  qaz48 4 4 4T!W: 1$$QQ00000 1 1r)r/rstrrr)r[rUr$r`rbs ` @@rrLrLs ==  DS#XST1d38n1DI1$1111111{D)))))r)argparser importlibrtypesrtypingrrrr omegaconfr r torchtune.config._errorsr torchtune.utils._loggingr rrcrboolr#rArZrLr(rrrls######))))))))))))++++++++777777>>>>>>>> C j T    YtCH~z9:YtYYYYH3H3HHHHVQ0 Q0T#YQ0:Q0Q0Q0Q0h*S#X********r