`ildZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z ddlmZddlmZmZdd lmZmZmZmZmZmZmZmZmZd d lmZmZm Z erdd l!m"Z"ej#e$Z%e d Z&e'e e(e dfe e(e dffZ)dZ*dZ+dZ,dZ-dZ.dZ/GddZ0Gdde0Z1d#de2fdZ3d$de2de2fdZ4dZ5dZ6dZ7Gd d!ee(ee)fZ8d"gZ9dS)%z-Factory function to build auto-model classes.N) OrderedDict)Iterator)AnyTypeVarUnion)PretrainedConfig)get_class_from_dynamic_moduleresolve_trust_remote_code) CONFIG_NAME cached_file copy_funcextract_commit_hashfind_adapter_config_fileis_peft_availableis_torch_availableloggingrequires_backends) AutoConfigmodel_type_to_module_name!replace_list_option_in_docstrings)GenerationMixin_TaJ This is a generic model class that will be instantiated as one of the model classes of the library when created with the [`~BaseAutoModelClass.from_pretrained`] class method or the [`~BaseAutoModelClass.from_config`] class method. This class cannot be instantiated directly using `__init__()` (throws an error). ax Instantiates one of the model classes of the library from a configuration. Note: Loading a model from its configuration file does **not** load the model weights. It only affects the model's configuration. Use [`~BaseAutoModelClass.from_pretrained`] to load the model weights. Args: config ([`PretrainedConfig`]): The model class to instantiate is selected based on the configuration class: List options attn_implementation (`str`, *optional*): The attention implementation to use in the model (if relevant). Can be any of `"eager"` (manual implementation of the attention), `"sdpa"` (using [`F.scaled_dot_product_attention`](https://pytorch.org/docs/master/generated/torch.nn.functional.scaled_dot_product_attention.html)), or `"flash_attention_2"` (using [Dao-AILab/flash-attention](https://github.com/Dao-AILab/flash-attention)). By default, if available, SDPA will be used for torch>=2.1.1. The default is otherwise the manual `"eager"` implementation. Examples: ```python >>> from transformers import AutoConfig, BaseAutoModelClass >>> # Download configuration from huggingface.co and cache. >>> config = AutoConfig.from_pretrained("checkpoint_placeholder") >>> model = BaseAutoModelClass.from_config(config) ``` ac Instantiate one of the model classes of the library from a pretrained model. The model class to instantiate is selected based on the `model_type` property of the config object (either passed as an argument or loaded from `pretrained_model_name_or_path` if possible), or when it's missing, by falling back to using pattern matching on `pretrained_model_name_or_path`: List options The model is set in evaluation mode by default using `model.eval()` (so for instance, dropout modules are deactivated). To train the model, you should first set it back in training mode with `model.train()` Args: pretrained_model_name_or_path (`str` or `os.PathLike`): Can be either: - A string, the *model id* of a pretrained model hosted inside a model repo on huggingface.co. - A path to a *directory* containing model weights saved using [`~PreTrainedModel.save_pretrained`], e.g., `./my_model_directory/`. - A path or url to a *tensorflow index checkpoint file* (e.g, `./tf_model/model.ckpt.index`). In this case, `from_tf` should be set to `True` and a configuration object should be provided as `config` argument. This loading path is slower than converting the TensorFlow checkpoint in a PyTorch model using the provided conversion scripts and loading the PyTorch model afterwards. model_args (additional positional arguments, *optional*): Will be passed along to the underlying model `__init__()` method. config ([`PretrainedConfig`], *optional*): Configuration for the model to use instead of an automatically loaded configuration. Configuration can be automatically loaded when: - The model is a model provided by the library (loaded with the *model id* string of a pretrained model). - The model was saved using [`~PreTrainedModel.save_pretrained`] and is reloaded by supplying the save directory. - The model is loaded by supplying a local directory as `pretrained_model_name_or_path` and a configuration JSON file named *config.json* is found in the directory. state_dict (*dict[str, torch.Tensor]*, *optional*): A state dictionary to use instead of a state dictionary loaded from saved weights file. This option can be used if you want to create a model from a pretrained configuration but load your own weights. In this case though, you should check if using [`~PreTrainedModel.save_pretrained`] and [`~PreTrainedModel.from_pretrained`] is not a simpler option. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. from_tf (`bool`, *optional*, defaults to `False`): Load the model weights from a TensorFlow checkpoint save file (see docstring of `pretrained_model_name_or_path` argument). force_download (`bool`, *optional*, defaults to `False`): Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request. output_loading_info(`bool`, *optional*, defaults to `False`): Whether ot not to also return a dictionary containing missing keys, unexpected keys and error messages. local_files_only(`bool`, *optional*, defaults to `False`): Whether or not to only look at local files (e.g., not try downloading the model). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. trust_remote_code (`bool`, *optional*, defaults to `False`): Whether or not to allow for custom models defined on the Hub in their own modeling files. This option should only be set to `True` for repositories you trust and in which you have read the code, as it will execute code present on the Hub on your local machine. code_revision (`str`, *optional*, defaults to `"main"`): The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. kwargs (additional keyword arguments, *optional*): Can be used to update the configuration object (after it being loaded) and initiate the model (e.g., `output_attentions=True`). Behaves differently depending on whether a `config` is provided or automatically loaded: - If a configuration is provided with `config`, `**kwargs` will be directly passed to the underlying model's `__init__` method (we assume all relevant updates to the configuration have already been done) - If a configuration is not provided, `kwargs` will be first passed to the configuration class initialization function ([`~PretrainedConfig.from_pretrained`]). Each key of `kwargs` that corresponds to a configuration attribute will be used to override said attribute with the supplied `kwargs` value. Remaining keys that do not correspond to any configuration attribute will be passed to the underlying model's `__init__` function. Examples: ```python >>> from transformers import AutoConfig, BaseAutoModelClass >>> # Download model and configuration from huggingface.co and cache. >>> model = BaseAutoModelClass.from_pretrained("checkpoint_placeholder") >>> # Update configuration during loading >>> model = BaseAutoModelClass.from_pretrained("checkpoint_placeholder", output_attentions=True) >>> model.config.output_attentions True >>> # Loading from a TF checkpoint file instead of a PyTorch model (slower) >>> config = AutoConfig.from_pretrained("./tf_model/shortcut_placeholder_tf_model_config.json") >>> model = BaseAutoModelClass.from_pretrained( ... "./tf_model/shortcut_placeholder_tf_checkpoint.ckpt.index", from_tf=True, config=config ... ) ``` a Instantiate one of the model classes of the library from a pretrained model. The model class to instantiate is selected based on the `model_type` property of the config object (either passed as an argument or loaded from `pretrained_model_name_or_path` if possible), or when it's missing, by falling back to using pattern matching on `pretrained_model_name_or_path`: List options Args: pretrained_model_name_or_path (`str` or `os.PathLike`): Can be either: - A string, the *model id* of a pretrained model hosted inside a model repo on huggingface.co. - A path to a *directory* containing model weights saved using [`~PreTrainedModel.save_pretrained`], e.g., `./my_model_directory/`. - A path or url to a *PyTorch state_dict save file* (e.g, `./pt_model/pytorch_model.bin`). In this case, `from_pt` should be set to `True` and a configuration object should be provided as `config` argument. This loading path is slower than converting the PyTorch model in a TensorFlow model using the provided conversion scripts and loading the TensorFlow model afterwards. model_args (additional positional arguments, *optional*): Will be passed along to the underlying model `__init__()` method. config ([`PretrainedConfig`], *optional*): Configuration for the model to use instead of an automatically loaded configuration. Configuration can be automatically loaded when: - The model is a model provided by the library (loaded with the *model id* string of a pretrained model). - The model was saved using [`~PreTrainedModel.save_pretrained`] and is reloaded by supplying the save directory. - The model is loaded by supplying a local directory as `pretrained_model_name_or_path` and a configuration JSON file named *config.json* is found in the directory. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. from_pt (`bool`, *optional*, defaults to `False`): Load the model weights from a PyTorch checkpoint save file (see docstring of `pretrained_model_name_or_path` argument). force_download (`bool`, *optional*, defaults to `False`): Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request. output_loading_info(`bool`, *optional*, defaults to `False`): Whether ot not to also return a dictionary containing missing keys, unexpected keys and error messages. local_files_only(`bool`, *optional*, defaults to `False`): Whether or not to only look at local files (e.g., not try downloading the model). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. trust_remote_code (`bool`, *optional*, defaults to `False`): Whether or not to allow for custom models defined on the Hub in their own modeling files. This option should only be set to `True` for repositories you trust and in which you have read the code, as it will execute code present on the Hub on your local machine. code_revision (`str`, *optional*, defaults to `"main"`): The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. kwargs (additional keyword arguments, *optional*): Can be used to update the configuration object (after it being loaded) and initiate the model (e.g., `output_attentions=True`). Behaves differently depending on whether a `config` is provided or automatically loaded: - If a configuration is provided with `config`, `**kwargs` will be directly passed to the underlying model's `__init__` method (we assume all relevant updates to the configuration have already been done) - If a configuration is not provided, `kwargs` will be first passed to the configuration class initialization function ([`~PretrainedConfig.from_pretrained`]). Each key of `kwargs` that corresponds to a configuration attribute will be used to override said attribute with the supplied `kwargs` value. Remaining keys that do not correspond to any configuration attribute will be passed to the underlying model's `__init__` function. Examples: ```python >>> from transformers import AutoConfig, BaseAutoModelClass >>> # Download model and configuration from huggingface.co and cache. >>> model = BaseAutoModelClass.from_pretrained("checkpoint_placeholder") >>> # Update configuration during loading >>> model = BaseAutoModelClass.from_pretrained("checkpoint_placeholder", output_attentions=True) >>> model.config.output_attentions True >>> # Loading from a PyTorch checkpoint file instead of a TensorFlow model (slower) >>> config = AutoConfig.from_pretrained("./pt_model/shortcut_placeholder_pt_model_config.json") >>> model = BaseAutoModelClass.from_pretrained( ... "./pt_model/shortcut_placeholder_pytorch_model.bin", from_pt=True, config=config ... ) ``` c(|t|}t|ttfs|Sd|D}t |dg}|D]8}||vr ||cSd||vr |d|cSd||vr |d|cS9|dS)Nci|] }|j| S__name__).0models y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py z$_get_model_class..sIIIuU^UIII architecturesTFFlaxr)type isinstancelisttuplegetattr)config model_mappingsupported_models name_to_modelr%archs r"_get_model_classr2s$T&\\2 &u 6 6 II8HIIIMFOR88M00 =  & & & & $[[M ) ) d- - - - D]]m + + / / / /, A r$ceZdZdZd dZedZededefdZede e e j e ffdZ ed d d ZdS) _BaseAutoModelClassNreturncnt|jjd|jjd|jjd)Nz+ is designed to be instantiated using the `z5.from_pretrained(pretrained_model_name_or_path)` or `z.from_config(config)` methods.)OSError __class__r)selfargskwargss r"__init__z_BaseAutoModelClass.__init__sV~& H H.1 H H' H H H   r$c l|dd}t|do |j|jv}t ||jv}|rM|j|j}d|vr|dd}nd}t||j|||}|r|rd|vr|d\}}n|j }t||fi|} |s3| |j | d| ||d d} t| } | j|fi|St ||jvr#t!||j} | j|fi|St#d |j d |jd d d|jDd)Ntrust_remote_codeauto_map--r upstream_repoTexist_ok auto_class code_revision!Unrecognized configuration class  for this kind of AutoModel: . Model type should be one of , c3$K|] }|jV dSNrr cs r" z2_BaseAutoModelClass.from_config..$4\4\AQZ4\4\4\4\4\4\r$.)pophasattrrr?r(_model_mappingsplitr _name_or_path name_or_pathr registerr8register_for_auto_class$add_generation_mixin_to_remote_model _from_configr2 ValueErrorjoin) clsr-r;r>has_remote_codehas_local_code class_refrBrepo_id model_class_s r" from_configz_BaseAutoModelClass.from_configs$"JJ':DAA!&*55Y#,&/:Yf);;   5Iy  ) 5 5a 8 $ 9!6#7hu!!!   >0 >y  %.__T%:%:" -7 7UUfUUK" D V-{T JJJ33s3CCC ?D11A>{KKK+;+F==f== = &\\S/ / /*633EFFK+;+F==f== = `0@ ` `_b_k ` `+/994\4\I[4\4\4\+\+\ ` ` `   r$r-c|S)z`Additional autoclass-specific config post-loading manipulation. May be overridden in subclasses.r)r_r-s r"_prepare_config_for_auto_classz2_BaseAutoModelClass._prepare_config_for_auto_classs  r$pretrained_model_name_or_pathc @ dd}d}dd<gd}fd|D}dd}dd} d d} |d d} |d d} | -tjd t| t d | } | | |d <| Nt |ts(t|tfdddd|} t| | } nt|dd} trg| i} | | | d <t|fd| i| }|Kt|dd5}tj|}|| d<|d}dddn #1swxYwYt |tst#j}ddkrd}ddkrd}dd}t'j|fd|| d|\}|dddkrdd<|dddkrdd<|dd |dd<t+|do |j|jv}t1||jv}d}|r1|j|j}d|vr|dd}t7|||||}|d<| d <|r|rt9||fd|i|}|dd}|s3||j|d||tA|}|j|g|Rd|i|St1||jvrbtC||j}|j"|j#d dkr|$}|j|g|Rd|i|St d!|jd"|jd#d$%d%|jDd&)'Nr-r>T _from_auto) cache_dirforce_downloadlocal_files_onlyproxiesresume_downloadrevision subfolderuse_auth_tokentokencDi|]}|v||Sr)rS)r namer;s r"r#z7_BaseAutoModelClass.from_pretrained..s-\\\TU[^^dFJJt,,^^^r$rG _commit_hashadapter_kwargsrtrszrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.zV`token` and `use_auth_token` are both specified. Please set only the argument `token`.F) _raise_exceptions_for_gated_repo%_raise_exceptions_for_missing_entries'_raise_exceptions_for_connection_errorsrzutf-8)encoding_adapter_model_pathbase_model_name_or_path torch_dtypeautodtypequantization_config)return_unused_kwargsrGrwr?r@rrArCrE text_configrHrIrJrKc3$K|] }|jV dSrMrrNs r"rPz6_BaseAutoModelClass.from_pretrained..arQr$rR)&rSgetwarningswarn FutureWarningr]r)r r r rr,rropenjsonloadcopydeepcopyrfrom_pretrainedrTrr?r(rUrVr r rYr8rZr[r2 config_class sub_configsget_text_configr^)r_ri model_argsr;r-r>hub_kwargs_names hub_kwargsrG commit_hashrxrtrsresolved_config_filemaybe_adapter_pathfadapter_config kwargs_origrer`rarBrbrds ` r"rz#_BaseAutoModelClass.from_pretrainedskHd++"JJ':;;#|    ]\\\9I\\\  ?D99 jj66 $4d;;w--#(8$??  % ME     l#E  "'Jw   f&677 D'21(6;:?{KKK.;.-0:CIMW[a &\\S/ / /*633EFFK'6+=+A+A-QU+V+VVV//11.;.-0:CIMW[a  `0@ ` `_b_k ` `+/994\4\I[4\4\4\+\+\ ` ` `   s4"F""F&)F&Fct|dr0|jj|jkrtd|jd|d|j|||dS)a Register a new model for this class. Args: config_class ([`PretrainedConfig`]): The configuration corresponding to the model to register. model_class ([`PreTrainedModel`]): The model to register. rzThe model class you are passing has a `config_class` attribute that is not consistent with the config class you passed (model has z and you passed z!. Fix one of those so they match!rCN)rTrrr]rUrY)r_rrdrDs r"rYz_BaseAutoModelClass.registerds ; / / K4L4UYeYn4n4n.6A6N..`l...  ##L+#QQQQQr$r5NF)r __module__ __qualname__rUr< classmethodrfr rhrstrosPathLikerrYrr$r"r4r4sN    $ $ [$ L4DIY[M E#r{SVGWBW>>>>>H&8&8&:&:;; ::n % % 1OPP P ::+U 3 3 a_`` `zz.&2EFF  ?F4HII "(**-FHf"g"gjj0BCC ##2%'$;#    #uww"644V444r$c|dd}|r|j|g|Ri|Stj|g|Ri|S)Nuse_timm_backboneF)rSrrr)r_rirr;rr8s r"rz&_BaseAutoBackboneClass.from_pretrainedsp"JJ':EBB  q:3:;Xp[epppiopp p&uww&'D\z\\\U[\\\r$)rrrrUrrr __classcell__)r8s@r"rrxsuN5555[52]]]][]]]]]r$rhead_docct|dkr|dd|dS|ddS)Nrz(one of the model classes of the library z0one of the model classes of the library (with a z head) z-one of the base model classes of the library )lenreplace) docstringrs r"insert_head_docrs\ 8}}q  6 Px P P P      24c  r$google-bert/bert-base-casedcheckpoint_for_examplec|j}|j}tt|}|d||_t tj}tt|}|d|}|d|}||_t|jd|}t||_| drt}n$| drt}nt}t tj} t||}|d|}|d|}|dd d d } |d | }|| _t|j| } t| |_|S) N)rBaseAutoModelClasscheckpoint_placeholderF)use_model_typesr&r'/-rshortcut_placeholder)rUrrCLASS_DOCSTRINGr__doc__rr4rfFROM_CONFIG_DOCSTRINGrr startswithFROM_PRETRAINED_TF_DOCSTRINGFROM_PRETRAINED_FLAX_DOCSTRINGFROM_PRETRAINED_TORCH_DOCSTRINGrrV) r_rrr.rvclass_docstringrffrom_config_docstringfrom_pretrained_docstringrshortcuts r"auto_class_updaters&M EECK/;<.s.GGQ-fa88GGGGGGr$ transformerszCould not find z neither in z nor in !z in )r)r+rTr, importlib import_modulerr])rattrtransformers_modules` r"rrs  |t$HGGGG$GGGGGGvt%vt$$$$1.AA $$$ i+,?FF F i i igtggggQdggghh h iK4KK5HKKKLLLs 1B$B%cvdt|jvr|Sdt|jvr|St|dodtt |dv}t|dodtt |dv}|s|r&t |j|tfi|j}|S|S)a Adds `GenerationMixin` to the inheritance of `model_class`, if `model_class` is a PyTorch model. This function is used for backwards compatibility purposes: in v4.45, we've started a deprecation cycle to make `PreTrainedModel` stop inheriting from `GenerationMixin`. Without this function, older models dynamically loaded from the Hub may not have the `generate` method after we remove the inheritance. ztorch.nn.modules.module.Modulergenerateprepare_inputs_for_generation) r__mro__ __bases__rTr,r(rr__dict__)rdhas_custom_generate_in_classhas_custom_prepare_inputs!model_class_with_generation_mixins r"r[r[s(s;3F/G/GGGC 56666$+; #C#C$HYad Z((bbI !( 5T U U!Zksv <==tt[$1'@1,0  ;"@BZ[EYBZ- - )10 r$cJeZdZdZddZdefdZdeede fdZ dZ de eefd Z deed edee effd Zdefd Zde e fd Zde eeee ffdZdeeefdZdedefdZddeede ddfdZdS)_LazyAutoMappinga " A mapping config to object (model or tokenizer for instance) that will load keys and values when it is accessed. Args: - config_mapping: The map model type to config class - model_mapping: The map model type to model (or tokenizer) class r5Nc||_d|D|_||_||j_i|_i|_dS)Nci|]\}}|| Srr)r kvs r"r#z-_LazyAutoMapping.__init__..s'P'P'PA1'P'P'Pr$)_config_mappingitems_reverse_config_mappingrU_extra_content_modules)r9config_mappingr.s r"r<z_LazyAutoMapping.__init__sR-'P'P9M9M9O9O'P'P'P$+-1*  r$ct|j|j}t |t |jzSrM)setrkeys intersectionrUrr)r9 common_keyss r"__len__z_LazyAutoMapping.__len__sY$.335566CCDDWD\D\D^D^__ ;#d&9":":::r$keycz|jvr |jS|jj}||jvr#|j|}|||Sfd|jD}|D]0}||jvr%|j|}|||cS1t)Nc0g|]\}}|jk|Srr)r rrrs r" z0_LazyAutoMapping.__getitem__..*s)WWWTQQ#,EVEVqEVEVEVr$)rrrrU_load_attr_from_modulerrKeyError)r9r model_type model_name model_typesmtypes ` r" __getitem__z_LazyAutoMapping.__getitem__!s $% % %&s+ +1#,? , , ,,Z8J..z:FF FXWWWT%9%?%?%A%AWWW   F FE+++!07 225*EEEEE,smmr$ct|}||jvr tjd|d|j|<t |j||S)NrRztransformers.models)rrrrr)r9rr module_names r"rz'_LazyAutoMapping._load_attr_from_module1sV/ ;; dm + +)2)@AR[ARARTi)j)jDM+ &' k(BDIIIr$cfdjD}|tjzS)NcTg|]$\}}|jv||%Sr)rUrr rrvr9s r"rz)_LazyAutoMapping.keys..8sE   Td)))  ' 'T 2 2)))r$)rrr*rr)r9 mapping_keyss` r"rz_LazyAutoMapping.keys7s^    !17799   d4#6#;#;#=#=>>>>r$defaultcR ||S#t$r|cYSwxYwrM)r r)r9rrs r"rz_LazyAutoMapping.get?s? ##C(( (   NNN s  &&cDt|SrM)boolrr9s r"__bool__z_LazyAutoMapping.__bool__EDIIKK   r$cfdjD}|tjzS)NcTg|]$\}}|jv||%Sr)rrrs r"rz+_LazyAutoMapping.values..IsE   Td***  ' 'T 2 2***r$)rUrr*rr)r9mapping_valuess` r"rz_LazyAutoMapping.valuesHs^    !06688    T%8%?%?%A%A B BBBr$c|fdjD}|tjzS)Ncg|]M}|jv |j||j|fNSr)rrrU)r rr9s r"rz*_LazyAutoMapping.items..Qsm   d*** ++C1Ec1JKK++C1DS1IJJ  +**r$)rUr*rr)r9 mapping_itemss` r"rz_LazyAutoMapping.itemsPsT    *    tD$7$=$=$?$?@@@@r$cDt|SrM)iterrrs r"__iter__z_LazyAutoMapping.__iter__[rr$itemc||jvrdSt|dr|j|jvrdS|j|j}||jvS)NTrF)rrTrrrU)r9r"rs r" __contains__z_LazyAutoMapping.__contains__^sX 4& & &4tZ(( DMA],],]51$-@ T000r$Fvaluect|dr>|j|jvr0|j|j}||jvr|st d|d||j|<dS)z7 Register a new model in this mapping. r'z*' is already used by a Transformers model.N)rTrrrUr]r)r9rr%rDrs r"rYz_LazyAutoMapping.registerfsu 3 # # V 8T(T(T5clCJT0000 !TS!T!T!TUUU#(C   r$rr)rrrrr<intrr(r _LazyAutoMappingValuer rr*rrrrrrrr+rrr!r$rYrr$r"rr s;;;;;t$45:O JJJ ?d4 012????t,-uEZ\^E^?_ !$!!!!C23CCCC AtE$'7"8:O"OPQ A A A A!(4(8#9:!!!!11$1111 ) )D!12 );P )ei ) ) ) ) ) )r$rr)r)rr):rrrrrr collectionsrcollections.abcrtypingrrrconfiguration_utilsr dynamic_module_utilsr r utilsr r rrrrrrrconfiguration_autorrr generationr get_loggerrloggerrr+r(r)rrrrrr2r4rrrrrrr[r__all__rr$r"r5s43  ######$$$$$$&&&&&&&&&&333333\\\\\\\\                      ihhhhhhhhh.------  H % % WT]]eDItO4eDItO6LLM4j#Xa Fa"H(XRXRXRXRXRXRXRXRv$]$]$]$]$]0$]$]$]N  3 be    FMMM(@c)c)c)c)c){4(8#9;P#PQc)c)c)L .r$