*`i#ddlmZmZddlmZmZddlmZddlm Z gdZ eGddeZ eGdd eZ Gd d ee Z d S) )Enumunique)ListOptional) RegistryMixin) BaseModel)SparsityCompressionConfigCompressionFormatSparsityStructurec:eZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d S) r densezsparse-bitmaskzsparse-24-bitmaskz int-quantizedzfloat-quantizedznaive-quantizedzpack-quantizedz marlin-24zmixed-precisionznvfp4-pack-quantizedzmxfp4-pack-quantizedN)__name__ __module__ __qualname__r sparse_bitmasksparse_24_bitmask int_quantizedfloat_quantizednaive_quantizedpack_quantized marlin_24mixed_precisionnvfp4_pack_quantizedmxfp4_pack_quantizedr/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/compressed_tensors/config/base.pyr r sJ E%N+#M'O'O%NI'O11rr c:eZdZdZdZdZdZdZedZ dS)r as An enumeration to represent different sparsity structures. Attributes ---------- TWO_FOUR : str Represents a 2:4 sparsity structure. ZERO_ZERO : str Represents a 0:0 sparsity structure. UNSTRUCTURED : str Represents an unstructured sparsity structure. Examples -------- >>> SparsityStructure('2:4') >>> SparsityStructure('unstructured') >>> SparsityStructure('2:4') == SparsityStructure.TWO_FOUR True >>> SparsityStructure('UNSTRUCTURED') == SparsityStructure.UNSTRUCTURED True >>> SparsityStructure(None) == SparsityStructure.UNSTRUCTURED True >>> SparsityStructure('invalid') Traceback (most recent call last): ... ValueError: invalid is not a valid SparsityStructure z2:4 unstructuredz0:0ctt|}||n||_|S)N)object__new__lower_value_)clsvalueobjs rr"zSparsityStructure.__new__Qs0nnS!!','8ekkmmme  rc||jS|D]#}|j|kr|cS$t|d|j)Nz is not a valid ) UNSTRUCTUREDr&r# ValueErrorr)r%r&members r _missing_zSparsityStructure._missing_Vsb =# #  F|u{{}},, -EAA3<AABBBrN) rrr__doc__TWO_FOURr) ZERO_ZEROr" classmethodr,rrrr r (s_!!FH!LI CC[CCCrr ceZdZUdZeed<dZeeeed<dZ eeeed<dZ ee ed<dZ eeed <dS) r a Base data class for storing sparsity compression parameters :param format: name of compression format :param targets: List of layer names or layer types that aren't sparse and should be ignored during compression. By default, assume all layers are targeted :param ignore: List of layer names (unique) to ignore from targets. Defaults to None :param global_sparsity: average sparsity of the entire model :param sparsity_structure: structure of the sparsity, such as "unstructured", "2:4", "8:16" etc formatNtargetsignoregglobal_sparsityrsparsity_structure) rrrr-str__annotations__r3rrr4r5floatr6rrrr r as   KKK#'GXd3i '''"&FHT#Y &&&'*OXe_***(6 66666rr N)enumrrtypingrrcompressed_tensors.registryrpydanticr__all__r r r rrrr?s!!!!!!!!555555 R Q Q 2 2 2 2 2 2 2 25C5C5C5C5C5C5C5Cp77777 y77777r