§ *`ƒi¸ ãóŒ—ddlmZddlZddlmZddlmZmZddlm Z dgZ dej j defd „Z dej j fd „ZdS) é)ÚDictN)ÚTRANSFORM_CONFIG_NAME)ÚTransformConfigÚTransformFactory)Úhas_offloaded_paramsÚapply_transform_configÚmodelÚconfigcóä—|j ¦«D]0\}}tj||¬¦«}| |¦«Œ1t |t |¦«t|¦«dS)a  Apply a transform config to a model. Weight transforms are fused into weights, while activation transforms are attached as submodules and trigger via pytorch hooks :param model: model to apply config to :param config: transform config to apply )ÚnameN)Ú config_groupsÚitemsrÚ from_schemeÚapply_to_modelÚsetattrrÚ_tie_offloaded_tensors)r r r ÚschemeÚfactorys úv/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/compressed_tensors/transform/apply.pyrrs}€ðÔ,×2Ò2Ñ4Ô4ð&ð&‰ ˆˆfÝ"Ô.¨v¸DÐAÑAÔAˆØ×Ò˜uÑ%Ô%Ð%Ð%õ ˆEÕ(¨&Ñ1Ô1Ð1õ ˜5Ñ!Ô!Ð!Ð!Ð!ócóJ—t¦«}| ¦«D]}t|¦«rn| d¬¦«D]W\}}|jj| ¦«}||vrt||¦«||<t||||¦«ŒXŒ€dS)a When accelerate replaces tensors with meta tensors during offloading, the meta tensors may not be identical, even if the offloaded values are identical. However, transformers can only serialize correctly if meta tensors are identical (see transformers#39263). This function collects all meta tensors which have shared offloaded values and sets those tensors to be identical so that they can be removed during serialization :param model: model potentially containing offloaded meta tensors to fix F)ÚrecurseN) ÚdictÚmodulesrÚnamed_parametersÚ_hf_hookÚ weights_mapÚdata_ptrÚgetattrr)r Ú ptr_to_metaÚmoduleÚkeyÚ_Ú offloaded_ptrs rrr/s¾€õ 26±´€KØ—-’-‘/”/ðAðAˆÝ  Ñ 'Ô 'ð AØ ×1Ò1¸%Ð1Ñ@Ô@ð Að A‘QØ &¤Ô ;¸CÔ @× IÒ IÑ KÔ K à ¨ Ð3Ð3Ý18¸ÀÑ1EÔ1EK  Ñ.ݘ  [°Ô%?Ñ@Ô@Ð@Ð@øðAðAr)ÚtypingrÚtorchÚcompressed_tensorsrÚcompressed_tensors.transformrrÚ compressed_tensors.utils.offloadrÚ__all__ÚnnÚModulerr©rrúr.s¾ððÐÐÐÐÐà € € € Ø4Ð4Ð4Ð4Ð4Ð4ØJÐJÐJÐJÐJÐJÐJÐJØAÐAÐAÐAÐAÐAð $Ð $€ð" %¤(¤/ð"¸?ð"ð"ð"ð"ð*A %¤(¤/ðAðAðAðAðAðAr