`icUddlmZddlmZmZddlmZmZmZddl m Z m Z ddl m Z ddlmZmZmZddlmZdd lZdSdZdSdZdTdZdUdZGddeZiZded<dVd"ZdVd#ZGd$d%eZ Gd&d'e ej!(Z!Gd)d*e ej"(Z"Gd+d,e ej#(Z#Gd-d.e ej$(Z$Gd/d0e ej%(Z%Gd1d2e ej&(Z&Gd3d4e ej'(Z'Gd5d6e ej((Z(Gd7d8e ej)(Z)Gd9d:e ej*(Z*Gd;de ej,(Z,Gd?d@e ej-(Z-GdAdBe ej.(Z.GdCdDe ej/(Z/GdEdFe ej0(Z0GdGdHe ej1(Z1GdIdJe ej2(Z2GdKdLe ej3(Z3GdMdNe ej4(Z4GdOdPe ej5(Z5GdQdRe ej6(Z6d S)W) annotations)ABCabstractmethod)AnyCallableSequence)log2ceil) DTypeLike)GGML_QUANT_SIZESGGMLQuantizationTypeQK_K)LazyNumpyTensorNshape Sequence[int] quant_typerreturntuple[int, ...]c t|\}}|d|zdkr$td|dd|jd|dg|dd|d|z|zRS)NrzQuantized tensor row size () is not a multiple of z block size ()r ValueErrornamerr block_size type_sizes _/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/gguf/quants.pyquant_shape_to_byte_shaper!s,Z8J  Ry:""EuRyEEYcYhEExBEEEFF F =U3B3Z =rj09< = ==c t|\}}|d|zdkr$td|dd|jd|dg|dd|d|z|zRS)Nrrz Quantized tensor bytes per row (rz type size (rrrs r quant_shape_from_byte_shaper$s,Z8J  Ry9!!HE"IHH^h^mHH|EHHHII I =U3B3Z =ri/*< = ==r"func"Callable[[np.ndarray], np.ndarray]arr np.ndarrayotyper oshapecF|d|jdf}d}|D]}||z}tj||}|jddzpd}tjfdtj||Dd|||S)Nrr )rdtypercJg|]}| S)ravel).0groupr%s r z,_apply_over_grouped_rows..%s-TTTEDDKK%%''TTTr")axisout)reshapernpempty concatenate array_split) r%r'r)r*rowsosizedimr5n_groupss ` r _apply_over_grouped_rowsr?s ;;CIbM* + +D E   (e , , ,C 1 #)HNTTTTR^D(5S5STTT[\beffff ;;v  r"nct|}tj|}|tjd||z zz}tj||zS)N)absr7floorsign)r@aflooredbs r np_roundfrI+sI AAhqkkG"(1G ,---A 71::>r"ceZdZdS) QuantErrorN)__name__ __module__ __qualname__r/r"r rKrK2sr"rKz)dict[GGMLQuantizationType, type[__Quant]] _type_traitsdataqtypecX|tjkr!|tjdS|tjkr!|tjdSt|x}| |Std|j d)NFcopyzQuantization for  is not yet implemented) rF32astyper7float32F16float16rOgetquantizeNotImplementedErrorrrPrQqs r r\r\8s $((({{2:E{222 &* * *{{2:E{222&& &! 3zz$!"Yej"Y"Y"YZZZr"c|tjkr|tjS|tjkr<|tjtjSt |x}| |Std|j d)NzDequantization for rU) rrVviewr7rXrYrZrWrOr[ dequantizer]rr^s r rbrbCs $(((yy$$$ &* * *yy$$++BJ777&& &! 3||D!!!!"[ "["["[\\\r"ceZdZUded<ded<ded<dZded<d Zd ed <d Zd ed<dZded<dZd/dZ e dZ e e d0dZ e e d0dZe d1dZe d1dZe d2dZe d2d Ze d3d"Ze d3d#Ze d4d'Ze d4d(Ze d5d,Ze d6d-Ze d6d.ZdS)7__QuantrrQintrrNz,np.ndarray[Any, np.dtype[np.float32]] | Nonegrid)rrztuple[int, int] grid_shaper/ztuple[int | float, ...]grid_mapz bytes | Nonegrid_hexc tdS)Nz-Quant conversion classes can't have instances) TypeError)selfs r __init__z__Quant.__init__XsHIIIr"rNonec6||_t|\|_|_t j|jtj|j f|_ t j|j tj |j f|_|tvsJ|t|<dS)N) meta_noop)rQr rrr_wrap_fn_Quant__quantize_arrayr7uint8_Quant__shape_to_bytes_Quant__quantize_lazy_Quant__dequantize_arrayrX_Quant__shape_from_bytes_Quant__dequantize_lazyrO)clsrQs r __init_subclass__z__Quant.__init_subclass__[s (8(?% -6  x!56   !0 8  "z3#9:! ! ! L((((! Ur"c |j|jdSttt |j}|dksJ|jjd|z}tj |jtj }| d}tj |dk|dz|dztj ddgtj  d z}|d |d z}| d tj d tddd|zDtj  d|fz }|d|zdz z d }tj |jtj d}tj||d}| ddg|jR|_dS)Nrr,)rrB@ )r rB.r.r )rr cg|]}|Sr/r/r1is r r3z%__Quant.init_grid..xs1^1^1^!1^1^1^r"r )r rrr4)rfrir r lenrhrQrr7 frombufferrsr6wherearrayrangerXtake_along_axisrg)ry bits_per_elemelems_per_byterfrhs r init_gridz__Quant.init_gridis 8 3<#7 FT#cl"3"34455 !!!39>!!!m+}S\:::||G$$dQh55<1a&XZX`AaAaAaAiAijpAqAqqF|d6l*||G$$1^1^U1anI\=]=]1^1^1^fhfn(o(o(o(w(wyz}KyL)M)MMm+q01::7CC8CL ;;;CCGLL!(Dr:::<<A 7 7 788r"blocksr(ctNr]ryrs r quantize_blocksz__Quant.quantize_blocks~ "!r"ctrrrs r dequantize_blocksz__Quant.dequantize_blocksrr"r;c|tjd}|j}|j|jz}|||jf}||}|jtj ksJ|jd|j ksJ|| |S)NFrSr) rWr7rXrsizerr6rr,rsrrtryr;rn_blocksrs r quantize_rowsz__Quant.quantize_rowss{{2:E{22 9.x899$$V,,|rx''''|B3=0000~~c22599:::r"c||tj}|j}|j|jz}|||jf}||}|jtj ksJ|jd|j ksJ|| |S)Nr) rar7rsrrrr6rr,rXrrwrs r dequantize_rowsz__Quant.dequantize_rowssyy"" 9 -x788&&v..|rz))))|B3>1111~~c44U;;<<eZdZeddZeddZdS)BF16rr(rc|tj}tj|dzdk|tjdztjdz|}tj|d|dz dzzzdz }|tjtjS)Niili@ir-r )rar7uint32ruint64rWuint16rs)ryrr@s r rzBF16.quantize_blockss KK " " Ha*n 2Q:9N9N5NRTR[\dReRe4egh i i Yq\\VR1}5 62 =xx ""''111r"c|tjtjdztjS)Nr-)rar7int16rWint32rXrs r rzBF16.dequantize_blockss; BH%%,,RX66"<BB2:NNNr"NrrLrMrNrrrr/r"r rrsX222[2OOO[OOOr"r)rQc>eZdZeddZeddZdS)Q4_0rr(rc|jd}t|dd}tj||d}|dz }tjd5tj|dkdd |z }dddn #1swxYwYtjtj|tj|ztjd ztj  tj  dd }| |d |jd zf}|ddddf|dd ddftj dzz}| tjtj }tj||gdS)NrrTr4keepdimsriignoredivider g!@r}rrB.r)rrCargmaxr7rerrstatertruncfloat64rXrWrsclipr6rrZrar9)ryrrimaxmaxdidqss r rzQ4_0.quantize_blockss<?6{{!!rD!99 B777 "H [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , ,Xrz&))BJrNN:bjooMUWU_ ` ` ` g ghjhp q q v vwxz| } } ZZ1cn&9: ; ; Q ]bamrx{{: ; HHRZ % %bh / /~q"gB////#B  BBct|jd}tj|dg\}}|tjtj}||dd|jdzftj ddgtj dz }|tj dz|dftj tj d z }||tjzS) NrrBrr rr}r r rBr rr|) rr7hsplitrarZrWrXr6rrrsint8)ryrrrrs r rzQ4_0.dequantize_blockss<? &1#&&2 FF2:   % %bj 1 1 ZZ2q#.A*=> ? ?28QPQFZ\ZbCcCcCcCkCklxCyCy y28D>>! * *Hb> : : A A"' J JRWUVZZ WBIIbj)))*r"Nrrr/r"r rrsR000[0& + + +[ + + +r"rc>eZdZeddZeddZdS)Q4_1rr(rc|jd}|dd}|dd}||z dz }tjd5tj|dkdd|z }dddn #1swxYwYtj||z |ztjd ztj tj  dd}| |d |j d zf}|d dddf|d dddftj d zz}|tj tj }|tj tj }tj|||gdS)NrrTrrrrr ?r}rB.rr)rrminr7rrrrXrWrsrr6rrZrar9) ryrrrrrrrms r rzQ4_1.quantize_blockss<?jjb4j00jjb4j00 3Y"  [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , Xv|r)BJsOO;2: N N N U UVXV^ _ _ d defhj k k ZZ1cn&9: ; ; Q ]bamrx{{: ; HHRZ % %bh / / JJrz " " ' ' 1 1~q!Rjr2222BB Bc|jd}tj|dg\}}tj|dg\}}|tjtj}|tjtj}||dd|jdzftj ddgtj dz }|tj dz|dftj}||z|zS) NrrBrr rr}rr) rr7rrarZrWrXr6rrrs)ryrrrrestrrs r rzQ4_1.dequantize_blockss<?)FQC((4 $$$2 FF2:   % %bj 1 1 FF2:   % %bj 1 1 ZZ2q#.A*=> ? ?28QPQFZ\ZbCcCcCcCkCklxCyCy y28D>>! * *Hb> : : A A"* M MB!|r"Nrrr/r"r rrsR333[3&   [   r"rc>eZdZeddZeddZdS)Q5_0rr(rcj|jd}t|dd}tj||d}|dz }tjd5tj|dkdd |z }dddn #1swxYwYtjtj|tj|ztjd ztj  tj  dd }| |d |jd zf}|ddddftj dz|dd ddftj dzz}tj| |d dftj dz dd |d} | tjtj }tj|| |gdS)NrrTrrirrr g0@r}rB.rr littler4bitorder)rrCrr7rrrrrrXrWrsrr6rpackbitsrZrar9) ryrrrrrrr_rqhs r rzQ5_0.quantize_blocks%s<?6{{!!rD!99 B777 #I [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , Hbj((2:b>>9RZ=M=MMUWU_ ` ` ` g ghjhp q q v vwxz| } } YY!S^q%89 : :ambhtnn,CAAAI"(1++1M N [Ha#455!D2X` a a a i ijrtu v v HHRZ % %bh / /~q"bk3333rcD|jd}tj|dg\}}tj|dg\}}|tjtj}|tj}||dftj dtdDtjdz }||d d|j dzftj ddgtj d z }|tjdztj }|tj d z|d f}||tj dzztj tj d z }||tjzS) NrrBrr cg|]}|Sr/r/rs r r3z*Q5_0.dequantize_blocks..E3I3I3I!A3I3I3Ir"rr}r rrrrr-)rr7rrarZrWrXrr6rrrrsr)ryrrrrrrqls r rzQ5_0.dequantize_blocks;s<?)FQC((44!%%B FF2:   % %bj 1 1 WWRY   ZZ1 & &"(3I3IuRyy3I3I3IQSQZ*[*[*[*c*cdk*l*l l ZZ2q#.A*=> ? ?28QPQFZ\ZbCcCcCcCkCklxCyCy y29T??" * *28 4 428D>>! * *Hb> : :B"(1++%& . .rw 7 7"'"++ EBIIbj)))*r"Nrrr/r"r rr$sR444[4*+++[+++r"rc>eZdZeddZeddZdS)Q5_1rr(rc|jd}|dd}|dd}||z dz }tjd5tj|dkdd|z }dddn #1swxYwYtj||z |ztjd ztj tj  dd}| |d |j d zf}|d dddftj d z|d dddftj dzz}tj | |ddftj dz dd |d} |tjtj }|tjtj } tj|| | |gdS)NrrTrrrrr rr}rB.rrrrrr)rrrr7rrrrXrWrsrr6rrrZrar9) ryrrrrrrr_rrrs r rzQ5_1.quantize_blocksPs#<?jjb4j00jjb4j00 3Y"  [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , Hfslb(2:c??:"* M M M T TUWU] ^ ^ c cdegi j j YY!S^q%89 : :ambhtnn,CAAAI"(1++1M N [Ha#455!D2X` a a a i ijrtu v v HHRZ % %bh / / JJrz " " ' ' 1 1~q!Rn26666rc|jd}tj|dg\}}tj|dg\}}tj|dg\}}|tjtj}|tjtj}|tj}||dftj dtdDtjdz }||d d|j dzftj ddgtj d z }|tjdztj }|tj d z|d f}||tj dzztj}||z|zS) NrrBrr cg|]}|Sr/r/rs r r3z*Q5_1.dequantize_blocks..rrr"rr}rrrr) rr7rrarZrWrXrr6rrrrs) ryrrrrrrrrs r rzQ5_1.dequantize_blocksfs<?)FQC((4)D1#&&44!%%B FF2:   % %bj 1 1 FF2:   % %bj 1 1 WWRY   ZZ1 & &"(3I3IuRyy3I3I3IQSQZ*[*[*[*c*cdk*l*l l ZZ2q#.A*=> ? ?28QPQFZ\ZbCcCcCcCkCklxCyCy y29T??" * *28 4 428D>>! * *Hb> : :B"(1++%& . .rz : :B!|r"Nrrr/r"r rrOsR777[7*[r"rc>eZdZeddZeddZdS)Q8_0rr(rc(t|dddz }tjd5tj|dkdd|z }dddn #1swxYwYt ||z}|tjtj }|tj tj }tj ||gdS) Nr Trrrrr) rCrr7rrrIrWrZrarsrr9)ryrrrrs r rzQ8_0.quantize_blocks}s KKOOTO 2 2S 8 [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , v{ # # HHRZ % %bh / / YYrw   $ $RX . .~q"gA....sA''A+.A+c2tj|dgd\}}|tjtj}|tjtj}||zS)NrBr r)r7splitrarZrWrXr)ryrrxs r rzQ8_0.dequantize_blocksskx!,,,1 FF2:   % %bj 1 1 FF27OO " "2: . .Ar"Nrrr/r"r rr|sR / / /[ /[r"rc&eZdZeddZdS)Q2_Krr(rcR|jd}tj|tdzg\}}tj|tdzg\}}tj|dg\}}|tjtj}|tjtj}||dztjz|tdzdf}||dz tjz|tdzdf} tj gdtj d } ||d dd f| z tj d z}||tdzdftj}||z| z }||d fS) Nrr-rrBrr rrBrr}r r rr rr) rr7rrrarZrWrXr6rrs) ryrrscalesrrrdmindlmlshifts r rzQ2_K.dequantize_blockss<?y$"*66 9TDAI;//D)D1#&&4 FF2:   % %bj 1 1yy$$++BJ776C<'' 333 < >$RT*VW?X Y YRX666>>|LLjj(B2.//58BHQKK G ZZ42:r2 3 3 : :2: F F "Wr\zz8R.)))r"NrrLrMrNrrr/r"r rrs2***[***r"rc&eZdZeddZdS)Q3_Krr(rc|jd}tj|tdzg\}}tj|tdzg\}}tj|dg\}}|tjtj}tj|dg\}} ||ddftj ddgtj dz }||df}| |ddftj gd tj d z } | |df} |tj d z| tj d ztj dzz}|tj tj d z tj}||z|ddf} ||ddd ftj gd tj dz } ||ddd tj dtdDtj dz } | |dtdzftj d z} | |dtdzftj dz} | tj dz } | tj | tj dztj z tj} | | z|tfS)Nrr|r r r})r rBr r-r)r rr rr rrr cg|]}|Sr/r/rs r r3z*Q3_K.dequantize_blocks..s>rzJJ&j ! !8R"3 4 4 ZZ2q"- . ."(<<>! * *Hb"+= > > E Ebj Q QB $$h%5666r"N)r r(rrr)rLrMrNr% staticmethodr#rrr/r"r rrs[LGGG\G0777[777r"rc&eZdZeddZdS)Q5_Krr(rc|jd}tj|dg\}}tj|dg\}}tj|tjg\}}tj|t dzg\}}|tjtj }|tjtj }t |\} } || tj z |ddf}|| tj z |ddf} | |dddftj ddgtj  d z } | |dddftj d tdDtj  d z }| tj d z |ddf} |tj dz |ddf}| |tj dzztj } || z| z |t fS) NrrBr|rr rrr}rcg|]}|Sr/r/rs r r3z*Q5_K.dequantize_blocks.."s;P;P;P!A;P;P;Pr"rr)rr7rrr%rrarZrWrXr#r6rrsr)ryrrrrr r rrr"rr&rr_s r rzQ5_K.dequantize_blockssW<?)FQC((4YtaS)) dy(9':;; 4$!)--B FF2:   % %bj 1 1yy$$++BJ77""6**A 2:&& & / /2q0A B BQXXbj))) 2 2Hb!3D E E ZZ2q"- . ."(Aq62R2R2R2Z2Z[g2h2h h ZZ2q"- . ."(;P;PuQxx;P;P;PXZX`2a2a2a2i2ijv2w2w w28D>>! * *Hb"+= > >28D>>! * *Hb"+= > > 2!$ % - -bj 9 9A ##Xt$4555r"Nrrr/r"r r)r)s2666[666r"r)c&eZdZeddZdS)Q6_Krr(rcX|jd}tj|tdzg\}}tj|tdzg\}}tj|tdzg\}}|tjtj}|tjtj}||z |tdzdf}| |dddftj ddgtj  d z }|tj d z |dd f}| |ddd ftj gd tj  d z }|tj dz |dd f}||tj dzztjtjd z }| |tdzdftj}||z |tfS)NrrBrr-r rr~r}rrrrr r ) rr7rrrarrWrXrZr6rrs) ryrrrrrr rr_s r rzQ6_K.dequantize_blocks+s<?9Vdai[11D9TDAI;//DIdTRZL11 RW%%,,RZ88 FF2:   % %bj 1 1 Z (DBJ!: ; ; ZZ2q"- . ."(Aq62R2R2R2Z2Z[g2h2h h28D>>! * *Hb"+= > > ZZ2q"- . ."(<<>! * *Hb"+= > > 2!$ % - -bg 6 6 D IIxR0 1 1 8 8 D DA$/000r"Nrrr/r"r r-r-*s2111[111r"r-c>eZdZeddZeddZdS)TQ1_0rr(rcJ|jd}t|dd}tjd5tj|dkdd|z }dddn #1swxYwYt ||z}|tjtjdztj }|ddd f|dd d f|dd df}}}| |dd d ftj gd tj  dz}tj |d |df}| |dd dftj gd tj  dz}tj |d |df}| |dddftj gdtj  dz}tj |d |df}tj |||gd}|tjdzdzdz}|tj }|tjtj }tj ||gdS)NrrTrrrr .r)Qrr r r}r r r4r rrr-r)r5r6rr r )rrCrr7rrrIrWrrsr6rsumr9rrZra) ryrrrrrqs0qs1rs r rzTQ1_0.quantize_blocksBs<? KKOOdO 3 3 [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , v{ # #ii  271::- 5 5bh ? ?#yy.)2cFV3D.D+Er#PVyy.GY"Skk8RB/0028::kk8RB/0028:: ZZ2q!, - -rx0X0X0X0`0`am0n0n n VBR ( ((B 8 8 ^S#rN 4 4 4ii ""S(G4 < YYrx  HHRZ % %bh / /~r1gB////A11A58A5c|jd}tj|tdtzdzz dzg\}}tj|tdzg\}}|tjtj}|dddf|dddf}}||dddftj gd tj d z}||df}||ddd ftj gd tj d z}||df}||dddftj gd tj dz}||df}tj |||gd}|tj dzdz tj tj dz }||tjzS)Nrrr~r4.rrr )r r rr6r5r}r7r-)r r rr6r rr r|)rr7rrrarZrWrXr6rrsr9rr) ryrrrrrrr<r=s r rzTQ1_0.dequantize_blocks[s<?9Vta$h"n'<&B%CDDD $ --A FF2:   % %bj 1 1c3B3h<CHSkk8RB/0028 > KBIIbj)))*r"Nrrr/r"r r0r0AsR000[00+++[+++r"r0c>eZdZeddZeddZdS)TQ2_0rr(rc|jd}t|dd}tjd5tj|dkdd|z }dddn #1swxYwYt ||z}|tjtjdztj }| |ddd ftj gd tj  d z}|d dddf|d dddfz|d dddfz|d dddfz}| |df}|tj  tj }tj||gdS)NrrTrrrr rrrr}r .rBr r)rrCrr7rrrIrWrrsr6rrZrar9)ryrrrrrs r rzTQ2_0.quantize_blocksrs<? KKOOdO 3 3 [ ) ) ) , ,!q&!QU++B , , , , , , , , , , , , , , , v{ # #ii  271::- 5 5bh ? ? ZZ2q"- . ."(<<cP|jd}tj|tdzg\}}|tjtj}||dddftj gdtj dz }|d z|dftj tj dz }||tjzS) Nrrrr rrr}r r ) rr7rrrarZrWrXr6rrsr)ryrrrrs r rzTQ2_0.dequantize_blockss<? &419+..A FF2:   % %bj 1 1 ZZ2q"- . ."(<<.@U@U@Uq@U@U@Ur"r|r r r r|rr)rr7rrarZrWrXrr6rrrGrsrrrrfrT) ryrrrrdbsignsrGrfs r rzIQ2_XXS.dequantize_blockss<? &1#&&2 FF2:   % %bj 1 1 WWRY   ' '"a 8 8 "*S//RZ2%5$=$=bj$I$II JRZX\M]M] ] ZZ2q!, - -6 ""Hb!#455...XZXa9b9b9b9j9jkt9u9uusz:::BB>RR4(118RA2FGG"65r::: xQ233rx@U@UERSHH@U@U@U]_]e7f7f7f7n7no{7|7||&!RZ]]BJrNNCC xQ233x###!#(BvJOO,=,=,B,B28,L,L,T,TV^`bdeghUi,j,jqsttt||Xr1a011T E!**Hb>:::r"Nr) rLrMrNrGrrgrhrirrr/r"r rErEsl L    J!H L &;;;[;;;r"rEc2eZdZdZdZdZed dZdS) IQ2_XS)r|rHs00000200050008000a001100140016001900200022002500280041004400460049005000520055005800610064008000820085008800910094009900a000010104010601090110011201150118011a0121012401400142014501480151015401600168018101840190010002020205020802110214022002410244025002550280028a02010404040604090410041204150418042104240440044204450448045104540456046004810484049004000502050505080511051405200541054405500561058005010604061006260640064206840600080208050808080a08110814082008250841084408500858088008a008aa08010904091009400981098909000a200a280a960aa00a011004100610091010101210151018102110241040104210451048105110541060106a108110841090100011021105110811111114112011411144115011801194119611011204120612101240126012001402140514081411141414201441144414491450146414801401150415101540150016141649160118041810181218401854188618001905196619511aa91a00200220052008200a201120142020204120442050208020a020012104211021402148216521002222228022a82201240424102429244024002541255225992501261a26a626002808280a28202855288828a22868299029082a202a822a882a8a2a014004400640094010401240154018402140244040404240454048404a405140544060406540814084409040004102410541084111411441204141414441504180418541a2410142044210421242294240420044024405440844114414441944204441444444504480449444014504451045244540459a4500460a4644465046014804481048404845485448624800491149444950496949044a00500250055008501150145020502850415044505050805001510451105115514051425100524452aa520154045410542154405460548154a154005508558055885521566856a156005814584158505899581a5940594259855a0160046010604060546062608660a960006124624a62926200641664106540654565a46501686a682569066a546a626a00800280058008801180148020802a8041804480508080808280a880aa8001810481068110814081518159810082208280828282a082a8820184048410841284158440846084898400854485a58518866a860088088825885a8880888288a8880689228a808a888a968aa88a019004901090409056908490009122916491569289920094059444945094589429959095929541965198a6984999159a609a00a002a008a00aa020a02aa0a0a051a159a1a6a100a202a208a22aa280a2a0a240a495a465a698a60aa820a822a828a8a0a8a8a804a984a986a928aa2aaa91aaaaaarr(rc :|jd}tj|dg\}}tj|dtzdzg\}}|tjtj}|tj}| |ddftj ddgtj  dz }|d z |df}|tjd |zztjd z}| |dddf}tj tjtj  ddd }tj||d z |ddfd}| |ddftj dt!dDtj  dz }|tj dz}tj|dktjdtjd}| |dddf}|jJtj|j|tjdz |dddfd} | |dddf} || z|z |dfS)NrrBr|rr rr}r r rBrrrMrTrrcg|]}|Sr/r/rs r r3z,IQ2_XS.dequantize_blocks.. =R=R=RAa=R=R=Rr"r r r|ir)rr7rrrarZrWrXrr6rrsrrErGrrrrf) ryrrrrrr rXrYrfs r rzIQ2_XS.dequantize_blockss<?)FQC((4Yta$h!m_55 F FF2:   % %bj 1 1 WWRY  2q 122bh1vRX6V6V6V6^6^_h6i6ii4-(((B88 "*S//F* +bj.>.> > ZZ2q!, - - gnBH===EEaCPP"527*;*;Xr1:::r"NrrLrMrNrgrhrirrr/r"r r[r[sLJ!H L F;;;[;;;r"r[c2eZdZdZdZdZed dZdS) IQ2_S)ir|rHs00000200050008000a0011001400160019002000220025002800410044004600490050005200550058006100640066006900800082008500880091009400a000a500aa0001010401060109011001120115011801210124014001420145014801510154015601590160016501680181018401900192019501a101a40100020202050208021102140220022a02410244024602490250025502800285028a029402a20201040404060409041004120415041804210424042604290440044204450448044a0451045404560459046004620465048104840486048904900495049804a104a40400050205050508050a0511051405160519052005250528054105440546054905500552055505580561056405800582058505880591059405a00501060406060609061006150640064506480651065406600681068406900600080208050808081108140816081908200825082a084108440846084908500852085508580861086408800885089408aa08010904091009120915091809210940094509480951095409600981099009000a110a140a220a280a2a0a500a990a01100410061009101010121015101810211024102610401042104510481051105410561059106010621065106810811084108610901095109810a110a41000110211051108110a1111111411161119112011221125112811411144114611491150115211551158116111641180118211851188119111941101120412091210121512211224124012451251125412811284129012001402140514081411141414161419142014251428144114441446144914501452145514581461146414801482148514881491149414a014011504150615091510151215151518152115241540154215451548155115541560158115841590150016051608161116141620164116441650168016aa160118041806180918101815181818211840184218451848185118541860188118841800190219051908191119141920194119441950196919a219041a101a401a561a00200220052008201120142016201920202025202a2041204420502052205520642080208a209420aa2001210421102112211521212140214221452151215421602181218421902100220a22222228222a224422502288228a22a8220124042406240924102415241824212424244024422445244824512454246024812484249024002505250825112514252025412544255025662580250126042610264026592600280528112814284128442850288a28aa2801290429102995290a2a222a642a882a8a2a014004400640094010401240154018401a4021402440264040404240454048404a40514054405640594060406240654081408440904095409840a140a440004102410541084111411441164119412041224125414141444146414941504152415541584161416441804182418541884191419441a04101420442104212421542184224424042454248425142544260428142844200440244054408440a44114414441644194420442244254428444144444446444944504452445544584461446444804482448544884491449444a044014504450645094510451245154518452145244540454245454548455145544560456a4581458445904500460246054608461146144620464146444650468046a546014804480948104812481548184821482448404842484548484851485448604884489048004902490549084911491449204941494449504980499649014a044a104a404a0050025005500850115014501650195020502250255028504150445046504950505052505550585061506450805082508550885091509450015104510651095110511251155118512151245140514251455148515151545160518151845190510052055208521152145220524152445250526952805201540454065409541054125415541854215424544054425445544854515454546054815484549054005502550555085511551455205541554455505580550156045610562656405600580258055808581158145820584158445850585a5880580159045910594059005a195a855aa85a016004600660106012601560186021602460406045604860516054606060846090600061026105610861116114612061416144615061806199610462106240625662a162006405640864116414642064416444645064806401650465106540654a6568659265006694660168046810686568986800692a69426aa16a00800280058008801180148019802080258041804480508052805580588061808080858091809480018104810981108112811581188121812481408142814581488151815481818184819081a981008205820a82118214824182448250820184048406840984108412841584188421844084428445844884518454846084818484849084008502850585088511851485208541854485508580858a85018604861086298640860088058811881488418844885088a2880189048940896589228a588a5a8a828aa28a01900490099010901290159018902490409042904590489051905490609081908490909000910591119114914191449150915a910192049210924092a69200940294059408941194149420944194449450948094969401950495109540959895a19500964696649601980498109826984098a998009949995299909a00a005a00aa014a022a02aa041a044a050a0a2a0aaa040a165a102a20aa222a228a22aa282a288a28aa2a8a201a404a410a440a489a4a4a400a519a551a60aa828a8a2a854a986a908aa0aaa20aa22aa28aa88aaaaaarr(rc |jd}tj|dg\}}tj|tdzg\}}tj|tdzg\}}tj|tdzg\}}|tjtj}||ddftj ddgtj d z }|d z|df}|tjd |zztjd z} | |dddf} ||ddftj d tdDtj dz }|tj dz}tj |dktjdtjd}||dddf}||ddftj gdtj dz }|tj |dztj dz|dfz}|jJtj|j||dddfd} | |dddf} | | z|z|dfS)NrrBr|rrr rr}r^rrrMcg|]}|Sr/r/rs r r3z+IQ2_S.dequantize_blocks..rr`r"rarrRr rrrr7rrrarZrWrXr6rrsrrrrfr) ryrrrrrrYrr rXrfs r rzIQ2_S.dequantize_blocksas<?)FQC((49TDAI;//Ditqyk22 tYtdbj\22 F FF2:   % %bj 1 12q 122bh1vRX6V6V6V6^6^_h6i6ii4-(((B88 "*S//F* +bj.>.> > ZZ2q!, - - xQ/00BH=R=Rq=R=R=RZ\Zb4c4c4c4k4klu4v4vv&!RZ]]BJrNNCC xQ233 ZZ2q) * *bh|||28.T.T.T.\.\]f.g.g g YYry ! !b4i%7%7 %B%Ba%G$P$PRZ\^Q_$`$` `x###!#(BJJ"a7K,L,LSUVVV||Xr1a011T E!**Hb>:::r"Nrrbr/r"r rdrdsLJ!H? L F;;;[;;;r"rdc2eZdZdZdZdZed dZdS) IQ3_XXS)r8r)rrrL$,4>s0000020004001100130017002000220031004200730075000101030110011201210125013001320141015401700100020202040211022002220231023302370251025702750201030703100312032503700313043704440457047304750401050705320552053506640610071407160743076107011003101010121021102310301032103410471050100011021111112011221101120312101212122112301272120013021320133113461366130114051450142015241546157115051622174017002002201120132020202220262031204220012103210521102112212121302163216721702100220222112217222022222237224022552201231023142370237423352453240325272541257425012703271627452701301030123021302330503065307230003102312031313144314631013203321032253252327232113333333034473472340035063522355535143636366336333760370440174035403740534057407441204237424042604266420743454304445144644425454345704505471047124730471250415070500051065126515551145232527252025353531054235427547254025531555056245742572460446046606460216161611762646230633663446405655265336603672167037005700770107032705270267140711272457252720073157333736073217441740075027524753076rr(rc >|jd}tj|dg\}}tj|tdzg\}}|tjtj}|tj}|tjd|dz tjzztjdz}| |dddf}| |ddftj gdtj  d z }tj tj tj  d } |tjd z |dddf}tj| |d }| |dddftj dt!dDtj  dz }|tjdz}tj|dktjdtjd}| |dddf}|jJtj|j| |dddfd } | |dddf} || z|z |dfS)NrrBrrrLrr rNr}rRrSrrcg|]}|Sr/r/rs r r3z-IQ3_XXS.dequantize_blocks..rVr"r|rWr)rr7rrrarZrWrXrr6rrrErGrsrrrrf) ryrrrrrr rXrYrGrfs r rzIQ3_XXS.dequantize_blockss<?)FQC((4Ytdai[11 F FF2:   % %bj 1 1RY'' "*S//Vr\$9$9"*$E$EE FTW X ZZ2q!, - -"a011RXnnnTVT]5^5^5^5f5fgp5q5qqw~RX>>>FF~VV4(118RA2FGG"65r::: xQ233rx@U@UERSHH@U@U@U]_]e7f7f7f7n7no{7|7||&!RZ]]BJrNNCC xQ233x###!#(BJJ"a7K,L,LSUVVV||Xr1a011T E!**Hb>:::r"Nrrbr/r"r ririsIJ?H L &;;;[;;;r"ric2eZdZdZdZdZed dZdS) IQ3_S)r\r)r r r4rOr rs00000100020005000700100011001200140016002000210025003300400042004500470051005300600062007100740077000001010102010401100111011501200123012701310135014401610165017201000201020502070210021302160221022502300234024202450247025102530270027302030311031503200322033103330336034403500352036703710375030004130417042104240432044004430451047004020504052005220526053305410545054705660573050606110613063106520671060007020704072007220726073307500754070010011002100410101011101310151017102010221031103410361054105610611072100011011103110611101114112111301133114111501152117011761100121212151217122012241232124012431255126012721201130413071310131313211327133013341341136213701303140514121414143114331442144614501454140115101513152115301532155115201624162716441646160117031710171217211735174117621770170020012003200520072010201220142016202120232027203020322041204320452050205220672070207320752000210221102113211721222125213121342142215121012204220722212223223022372241225322572271227422002302230523112322232423312333234223502366230124072420242324322435244124722475240425112522253725402553257025002602260726212655266126052711272627302743275027023011301330153017302230313033303530423044304730513063307130013103310531143121312331403160317231763100321232203232323432503201331033143321332333273330334133433347335533733303341134163422343134523460346434013510351235253532354435563573351636413601370337203722373537004004401240204024402740324041405040704002410741114113412241304135414341514155410142034210421542214233424042574262427042044311431343204322433143354300440244244437444044714405450745214562451346344660461047154730474347514702501050145022504050445047505250665074500151035105511251215132517251005211522352305236525352025307531053275344535153655373530154045420543254465412552655515553554256025704572257116013601560316033606060006120612761646112623462426255626262706200631463216340632564436462640065036534656065056640661167136700700470077020702270367040705470627002711171247143714571017204721072167221723072517202733273357353730174057413742074507422754275027631760077rr(rc |jd}tj|dg\}}tj|tdzg\}}tj|tdzg\}}tj|tdzg\}}|tjtj}||ddftj ddgtj d z }|d z|df}|dd|zzz} | |dddf} ||ddftj d tdDtj d z }|tj dz}tj |dktjdtjd}||dddf}||ddftj d tdDtj z }|dztj |df}|tj |dzz}|jJtj|j||dddfd} | |dddf} | | z|z|dfS)NrrBrrr|rr r}r^rcg|]}|Sr/r/rs r r3z+IQ3_S.dequantize_blocks..r`r"racg|]}|Sr/r/rs r r3z+IQ3_S.dequantize_blocks..s7L7L7La7L7L7Lr"rrrg) ryrrrrrrrYr rXrfs r rzIQ3_S.dequantize_blockss<?)FQC((49TDAI;//D9TDBJ<00D $ 44 v FF2:   % %bj 1 12q 122bh1vRX6V6V6V6^6^_h6i6ii4-(((B88 !a&j. ! ZZ2q!, - - xQ/00BH=R=Rq=R=R=RZ\Zb4c4c4c4k4klu4v4vv&!RZ]]BJrNNCC xQ233 ZZ2q) * *bh7L7L5887L7L7LTVT\.].].] ]4i   * * 2 2Hb> B B YYry ! !R1W -x###!#(BJJ"a7K,L,LSUVVV||Xr1a011T E!**Hb>:::r"Nrrbr/r"r rrrrsJJ?H L F;;;[;;;r"rrcReZdZdZdZdZejdZe d dZ d S) IQ1_S)ir|)rrr s 00000200050008000a00110015002000220028002a00450051005400560065008000820088008a009500a000a200a800aa000401050111011401160119011a012501410146014901520155015a0161016401660168018501910194019601a5010002020208020a0215022002220228022a02450251025902640269028002820288028a02910295029902a002a202a802aa0211041404160425044104490455045a046404650491049904a5040105040505050605150518051a052905400545054a0550055105540555055605590560056205650568056a0581059105950598059a05a105a405a505a605a90514061906410644065006520655065806600661066606690685069106940699060008020808080a0815082008220828082a0845085108560865088008820888088a089508a008a208a808aa0805091109140919092409250941095009510955096109640969099109940996099909a509000a020a080a0a0a150a200a220a280a2a0a450a510a590a610a650a800a820a850a880a8a0a950aa00aa20aa80aaa0a101011101410191024102510411044105010551058106110641065106910911094109610a110a5100111041106110911101112111511181121112411291145114a11501151115211541155115611591160116511841192119511a111a41111121412161225124012461249125212551258125a12641266128512911294129612a51201140614091414141514181419142114261441144514461448144a145114541455145614591462146514681484148914901494149514981499149a14a114a414a514a914021505150a151115141515151615191520152215251528152a1541154415451546155115521554155515561559155a1561156415651566156915801582158415851588158a159015911594159515961599159a15a015a215a51501160416051606161516161618161a1621162616401642164416451648164a1651165516561658165916611664166516681669166a1686168a1692169516a416a91611181618251841184418461849185018551858185a1860186118641866186918851891189418a5181019121915191a19211925194219441945194819511954195519561959195a19601965196a1989199119921995199819a119a619a919091a161a241a261a441a461a491a501a521a551a581a611a661a691a851a911a961a9a1a0020022008200a20152020202220252028202a20452051205920612065208020822088208a209520a020a220a520a820aa2005211121142119212521422144214921552158215a2161216421652166218521902196219921a521012208220a22112215222022222228222a2245225122562259226522812288228a2291229522a022a222a822aa220524142416241924252444244524462449245224552458245a2466248524912494249924a124a52409251525212529254025452548255125542555255925622565256825892590259425952598259a25a125a425a625a925052610261226192625264126492655266026612669268426862690269a260028022808280a2815282028222828282a2845285128542865288028822888288a28a028a228a828aa2809291129142919292529462949295229552961296429662969298529902996299929a429a529002a022a082a0a2a202a222a282a2a2a452a512a562a592a652a802a822a882a8a2a952aa02aa22aa82aaa2a054011401640254049405240554058405a4061406440664094409940a140a6400041014104410641094112411541164118411a41214126412941454148414a41514154415541564159415a41654168416a41814184418641904192419541a041a141a241054211421442164225424142524255425a426442694289429442a5420144154419442944454448444a44514454445544564461446244654468446a44814486448944904492449544a044a144a9440145024505450a4511451445154516451945204525452a45414544454545464549455045514554455545564558455945614564456545664569458245844585458845914594459545964599459a45a545a845aa450146054609461446154618461a462146244629464046424645464846504651465246554656465946624665466846814685468a4694469546a146a446a6460548114815481a48254842484948504855485848614864486648694885489148944896489948a5480149054906490a491049144915491849214924492649404945494a4951495249544955495649594960496249654966496a49864989499249954996499849a149a449a649a949164a444a464a494a554a584a5a4a644a694a944aa54a01500450055006500950125015501a5021502450295040504550485051505450555056505950655068508650895095509850a050a150a650a9500551085109510a5111511451155116511851195120512551265128512a5141514451455146514951505151515251545155515651585159515a51615164516551665169518251855191519451955196519951a051a551aa5101520652125215521a5221522452425245524a525152545255525652595262526552855290529252955299529a52a452045405541154145415541654185419542154255428542a54415444544554465449544a5450545154545455545654585459545a54615462546454655466546954805488548a5491549454955496549954a154a454a554aa5401550255045505550655095510551155125514551555165519551a552155245525552655295540554155425544554555465548554955505551555255545555555655585559555a5560556155645565556655685569556a5581558455855589558a559055915594559555965598559955a155a455a555a655a95500560156025604560656085609561156145615561856195620562156225624562556265628562956415645564656485649564a56505651565256545655565656585659565a566156645665566956825685568656885689568a56915695569a56a256a556a656a856a956045805580658095810581558185821582a58455848584a585158545855585658585859586058625864586558825889589058925895589858a158a9580159025905590a5911591459155916591959255941594459455946594959505951595259545955595659585959595a5961596459655966596959815985598959915994599559965998599959a559045a085a155a1a5a205a255a265a295a455a485a495a515a555a565a585a595a625a655a685a6a5a815a8a5a925a955a965a985a9a5aa15a05601460166019602560446050605560566058605a60616064606660696081609660a5600161046106610961126115612161226126612961456149615161556156615961656166616a6184618a6192619561a161a661a9611162166219624062416246625562566258626062856291629662a56211641264156416641a6421642664296440644264456448644a64516454645564566459645a646064626465648464856489649064926494649564966498649a64a164a464a964056508650a651165156516651965446545654665496550655165546555655665596561656465656566656965866589658a6591659565966599659a65a265a565a665a86502660966156620662666286629664066456648664a66516654665566566658665a666066656668668066826685668a669466966698669966a066a466a666aa661668196825684168526855685a6861686968856891689868a668016904691069156921692469266929694069416945694669486951695469556956695969606965696a69826984698a699569a169a469a569a969116a166a186a416a446a496a506a556a586a5a6a646a656a696a866a946a986a9a6aa66a0080028008800a802080228028802a8045805080518054805680598065808080828088808a809580a080a280a880aa8005811181148116811981258141814481498150815281558156815881598164816681698185818981948196819981a5810082028208820a8215822082228228822a8251825482598265828082828288828a829582a082a282a882aa821484198441844484518455845a846184648469849484998401850985128515851a85268529854085418545854885518554855585568559855a856585668568856a8581858485868589859085928595859885a68511861686198625864186448649864a865086558659865a86618666866a86858691869a86a4860088028808880a8815882088228828882a8841884588518854885988658869888088828888888a889588a088a288a888aa8805890689118914891689258941894489468949895089528955895a8961896489858996899989a589008a028a088a0a8a158a208a228a288a2a8a458a518a548a568a808a828a888a8a8a958aa08aa28aa88aaa8a059011901690189019902590419046904990559058905a9069906a9085909190949096909990a59001910491069109911091159118911a912191249126912991409145915091519154915591569159916291659184918691929195919891a191a491a691a99105921192149219922592449246924992509252925592589266926992859294929692a992019404940694109415941894269440944a945194549455945694589459946094619462946594849486949294949495949894a194a9940095059508950a951095119514951595169519952195259529952a9541954495459546954995509551955295549555955695589559955a95619564956595669569958195859588959195929594959595969599959a95a095a295a595a895aa950196049610961596199620962696299645964896499651965296559656965996659668968296849689968a96929694969596a496a696a99605981698199825984198469850985298559856985a98649865988598919896989998a59804990699099910991299159918991a99209921992499269940994299459948994a99519954995599569959996299659966996a99819984999099929995999a99a199a699059a159a259a449a469a499a509a559a589a619a859a919a949a959a969a00a002a008a00aa015a020a022a028a02aa045a051a054a056a059a080a082a088a08aa095a0a0a0a2a0a8a0aaa005a109a111a114a116a119a11aa146a149a151a155a158a15aa161a164a185a190a192a196a199a102a208a20aa210a219a222a228a22aa245a251a256a259a265a280a282a288a28aa295a2a0a2a2a2a8a2aaa219a425a441a444a450a454a455a458a45aa461a465a466a468a469a485a406a509a510a512a515a518a526a529a542a545a551a554a555a556a559a565a56aa581a584a585a586a589a592a595a598a505a611a616a61aa621a625a644a646a64aa652a655a656a658a660a662a686a690a695a696a699a6a1a6a4a6a6a600a802a808a80aa820a822a828a82aa851a854a856a859a880a882a888a88aa895a8a0a8a2a8a8a8aaa805a914a919a921a925a941a950a955a95aa961a966a969a990a996a900aa02aa08aa0aaa20aa22aa28aa2aaa51aa54aa56aa80aa82aa88aa8aaa95aaa0aaa2aaa8aaaaaag?rr(rc :|jd}tj|dg\}}tj|tdzg\}}|tjtj}|tj}|d|dz dzzdzz}| |dddf}tj |tjdzdk|j |j }| |dddf}| |ddftj gd tj  d z }|tj|dzdz |dfz}|j Jtj|j | |dddfd } | |dddf} || |zz |dfS)NrrBr|rrOr rirr rrr}rRrrr)rr7rrrarZrWrXrr6rdeltarrfr) ryrrrrrrr r|rfs r rzIQ1_S.dequantize_blockss<?)FQC((44$!)--B FF2:   % %bj 1 1 WWRY   !bA~&* + ZZ2q!, - -"ry000Q6 CI:NN xQ233 ZZ2q) * *bh|||29.U.U.U.].]^g.h.h h YYry ! !b1f]$;$;XrN$K$K Kx###!#(BJJ"a7K,L,LSUVVV||Xr1a011dUl#,,h^<<-> >28MMMacajCkCkCkCsCstzC{C{ { fI& !AfI -& 9 FF2:   % %bj 1 1 9 98Q- H H"a00BH\\\QSQZ4[4[4[4c4cdm4n4nn4-(((B88 !f*q. ! ZZ2q!Q/ 0 0 ZZ2q) * *bh1vRX.N.N.N.V.VW`.a.a a YYry ! !b4i%7%7 %B%Ba%G$P$PRZ\^Q_$`$` `daSYJ?? xQ1566x###!#(BJJ"a7K,L,LSUVVV||Xr1a344dUl#,,h^<< ? ?28QPQFZ\ZbCcCcCcCkCklxCyCy y28D>>! * *Hb!+< = =(3;bg666>>q!RHH  " 5 5 5 < .sCeCeCeaAECeCeCer"r)r rr rr r-r)r r r rr)rr7rrrarZrWrXrr6rrsrrrrr) ryrrrrscales_hscales_lrr r rs r rzIQ4_XS.dequantize_blockss<?)FQC((44!--$y |44 " FF2:   % %bj 1 1==++##Xr1$566"(Aq6QSQY:Z:Z:Z:b:bcl:m:mm##Xq"$566"(CeCeSXY]acYcSdSdCeCeCemomv:w:w:w::AK;L;LL##XrN33bhtnnD##XrN33::28DDrxPT~~Uh"(1++56>>rwGG"'RT++U&-- +++ 4 4hA5F G G ZZ2q"- . ."(Aq62R2R2R2Z2Z[g2h2h h ZZ2r1- . .$ ?(6>999AA-PP  " 5 5 5 < rsl"""""""########**********""""""CCCCCCCCCC!!!!!!>>>>>>>>    !  ;= <<<<[[[[]]]]{2{2{2{2{2c{2{2{2| O O O O O7.3 O O O O + + + + +7.3 + + + +F"""""7.3""""J(+(+(+(+(+7.3(+(+(+(+V*****7.3****Z7.34*****7.3****6)2)2)2)2)27.3)2)2)2)2X/7/7/7/7/77.3/7/7/7/7d666667.366666111117.31111.-+-+-+-+-+G/5-+-+-+-+`+++++G/5++++B>;>;>;>;>;g19>;>;>;>;BC;C;C;C;C;W07C;C;C;C;Le;e;e;e;e;G/5e;e;e;e;P1;1;1;1;1;g191;1;1;1;hD;D;D;D;D;G/5D;D;D;D;N`=`=`=`=`=G/5`=`=`=`=F$=$=$=$=$=G/5$=$=$=$=NW07*11111W07111111r"