Pi UddlmZmZddlZddlZddlmZejj Z iZ eeefe d<dZ e e j je jjgd dZe e jjgd dZe e jjgd dZe e jjgd d Ze e jjgd d Ze e jjgd d ZdS) )AnyDictN) SwizzleTensorSWIZZLE_OPS_TABLEcfd}|S)z)Register aten ops to the swizzle op tablec&D] }|t|< |SN)r)funcopaten_opss o/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchao/swizzle/swizzle_ops.py decoratorzimplements..decorators% ) )B$( b ! ! )r rs` r implementsrs$ rc\|d}|d}tj|rtj|r|jdkr|jdkr}d}d}t|tr|}d}t|tr|}d}t j||||}n`t|tr| n|}t|tr| n|}|||fi|}|S)NrFT) torchis_floating_pointndim isinstancer as_tensortorchaoops swizzle_mm unswizzle)aten_opargskwargsab a_is_swizzled b_is_swizzled tensor_outs r rrs" QA QA ""-  #A & &- FaKK FaKK  a ' ' ! A M a ' ' ! A M[++Aq-OO '=99 @AKKMMMq'=99 @AKKMMMqWQ,,V,, rc|d}|d}t|tr|n|}t|tr|n|}|||fi|S)Nrrrrr)rrr r!r"s r swizzle_bmmr(7sn QA QA#A}55< 1A#A}55< 1A 71a " "6 " ""rc|d}|d}|d}t|tr|n|}t|tr|n|}|||||ddfi|S)Nrrrr')rrr biasr!r"s r swizzle_addmmr,As 7D QA QA#A}55< 1A#A}55< 1A 74AtABBx 2 26 2 22rc |d}|d}|d}|d}t|dkrdn|d}t|dkrdn|d}t|dkrdn|d} d} d} t|tr|}d } t|tr|}d } t jj||| | ||||| f i|S) Nrrrr*FT)lenrrrrrswizzle_scaled_mm) rrr r!r"scale_ascale_br+ scale_result out_dtyper#r$s r r2r2Ks  QA QA1gG1gGt99>>44tAwDt99>>44tAwLD QDGIMM!]## KKMM !]## KKMM ; (         rc|d}|d}t|dkr,|ddkr |ddkr|S|||S)Nrrr)r1shallow_transposer)rrr tensordimss r swizzle_permuter;ksk !WF 7D 4yyA~~$q'Q,,47a<<''))) 76##%%t , ,,rc:|d}|S)Nr)r8)rrr r9s r swizzle_numpy_Tr=ts !WF  # # % %%rr )typingrrr torchao.opsrtorchao.swizzle.swizzle_tensorrratenr__annotations__rmmdefaultmatmulrbmmr(addmmr, _scaled_mmr2permuter;numpy_Tr=rrr rKs  888888 y~$&4S>&&& TW_dk1 233434 TX  ### # TZ  !!333"!3 T_ $ %&&'&> T\ ! "##---$#- T\ ! "##&&&$#&&&r