Pi) ddlZddlZddlZddlZddlmZmZmZe dej dddDZ e dkre dej ejdZd ZGd d Z dd ejjdeedeedeedef dZdZGddejjZGddeZGddeZGddeZdS)N)AnyCallableOptionalc#4K|]}t|VdSN)int).0is a/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/einx/nn/keras.py r s(BBAQBBBBBB.)rz5einx.nn.keras requires Keras version >= 3, but found kerasc|t|vrt||}n,||||||x}t||<|S)N)shapedtype initializername trainable)vars add_weight)layerrrrinitrtensors r create_or_retrieversg tE{{eT"%*%5%5 &6& &  eT" Mr ceZdZGddejjjZGddejjjZGddejj Z dS) ParamFactoryceZdZdZdZdS)ParamFactory.Concretec||_||_||_|t|dr|j}nd}||_||_dS)Nrfloat32)rrrhasattrrr)selfrrrrrs r __init__zParamFactory.Concrete.__init__sNDJDIDI}5'**&!KEE%EDJ&DNNNr cr|jt|j|j|j|jfSr)rrCacheKeyrrrrr%s r to_value_and_keyz&ParamFactory.Concrete.to_value_and_key-s4:|44 49dj$.   r N)__name__ __module__ __qualname__r&r*r r Concreter!s2 ' ' '     r r/c&eZdZdZdZdZdZdS)ParamFactory.CacheKeyc>||_||_||_||_dSrrrrrr%rrrrs r r&zParamFactory.CacheKey.__init__3"DIDIDJ&DNNNr cPt|j|j|j|jfSr)hashrrrrr)s r __hash__zParamFactory.CacheKey.__hash__9s!DItz4>JKK Kr ct|tjo?|j|jko/|j|jko|j|jko|j|jkSr) isinstancerr(rrrr)r%others r __eq__zParamFactory.CacheKey.__eq__<s_5,"7886I+6I+6J%+-6Neo5  r clt|j|j|j|j}||fSr)rTracerrrrr)r%backend virtual_argxs r to_tracerzParamFactory.CacheKey.to_tracerEs,##DIty$*dnUUAa4Kr N)r+r,r-r&r8r<rBr.r r r(r12sS ' ' '  L L L        r r(ceZdZdZdZdS)ParamFactory.Tracerc>||_||_||_||_dSrr3r4s r r&zParamFactory.Tracer.__init__Jr5r c H|j|jn|dd}|j|jn|dd}|j|jn|dd}|t d|t dt |t r|dks|dkr"tj d }n|d kr tj d }n|d kr tj d }n|dkrbtj fd|dD}tj d |z dz }tj d |}nNt d|dt |ttfrtj |}t jt&|||||jgt jS)Nrrrz7Must specify name for tensor factory keras.layers.Layerz7Must specify init for tensor factory keras.layers.Layerget_at rearrangeg{Gz?)stddevaddgmultiplyg?dotc g|] }| Sr.r.)r r rs r z0ParamFactory.Tracer.__call__..bs%J%J%J1eAh%J%J%Jr in_axisg۶%?)meanrIz3Don't know which initializer to use for operation '')argsoutput)rgetrr ValueErrorr:strtkeras initializersTruncatedNormalConstantnpprodsqrtrfloateinxtracerapplyrrTensor)r%rkwargsrrrfan_instds ` r __call__zParamFactory.Tracer.__call__Ps $(I$54996::fd;S;SD$(I$54996::fd;S;SD&*j&8DJJfjjRV>W>WE| !Z[[[| !Z[[[D#&& :8##t{':':!.>>d>KKDDU]]!.77<>CPS>TTDD$%b[_%b%b%bcccD3,// :*33D99;$$"D%dnE{))%00% r N)r+r,r-r&rfr.r r r>rDIs2 ' ' '      r r>N) r+r,r-r_r`inputInputr/r( TensorFactoryr>r.r r rrs4;$*(4;$-.%%%%%*%%%%%r rTrrrrrc>t|||||S)aCreate a tensor factory for Keras parameters. Args: layer: The layer to create the parameter in. Must be an instance of ``keras.layers.Layer``. name: Name of the parameter. If ``None``, uses a default name determined from the calling operation. Defaults to ``None``. init: Initializer for the parameter. If ``None``, uses a default init method determined from the calling operation. Defaults to ``None``. dtype: Data type of the parameter. If ``None``, uses the ``dtype`` member of the calling module or ``float32`` if it does not exist. Defaults to ``None``. trainable: Whether the parameter is trainable. Defaults to ``True``. Returns: A tensor factory with the given default parameters. )rr/)rrrrrs r paramrkqs ,  dE9 E EEr c^t|totd|DS)Nc3@K|]}t|tVdSr)r:r)r ys r r zis_leaf..s,'F'Fq 1c(:(:'F'F'F'F'F'Fr )r:tupleall)rAs r is_leafrqs. a   FC'F'FA'F'F'F$F$FFr c$eZdZfdZdZxZS)Layerc:tj|i|dSr)superr&)r%rRrc __class__s r r&zLayer.__init__s%$)&)))))r ctjd|t}dt j|jjvr||ddS||dS)NcDtj|dS)Nr#r)ropszeros)rs r zLayer.build..s%)//%y/AAr )rqis_initializingT)r})r_ tree_utiltree_maprqinspect signaturecall parameters)r% inputs_shapetracerss r buildz Layer.buildsz.)) A Ar#NstatsparamsrPvarscalebiasepsilonfastvarr decay_ratercc  t| ||_||_||_||_||_||_||_||_ | |_ | |_ dSNry) rur&rruse_meanuse_var use_scaleuse_biasrrrrc) r%rrrPrrrrrrrrcrvs r r&z Norm.__init__sj u%%%       $ r Fc V|jduo| p|}tjj||j|jf|r|jrt|ddn|j|r|jrt|ddn|j|j rt|ddnd|j rt|ddnd|j |j d|j |j ni\}}}|jduo|o| }|r|jrb|jt j|j|jjzd |jz |zz|jj|jrb|jt j|j|jjzd |jz |zz|jj|S) NrPF)rrrrTr)rPrrrrr)rr_nnnormrrrrkrrrrrrcrPassignrrzcastvaluerr)r%rAtrainingr}use_emarPr update_emas r rz Norm.calls/-Sx<3R?w| J K =t&E::::<d%8888?C~W%7d;;;;SW=A]Tt&D9999PTLL  #k5t{{2  4"_D0UXUoBU  }    INN$)/9Q=PTXrsB ********** 5BB!2!8!8!=!=bqb!ABBB B B f +aeN_aa b bb   W % %   QQQQQQQQl FF < F 3-F 3-F C= F  FFFF2GGG     EL    SSSSS5SSSl     U   8er