Pi@ddlZddlmZGddejZdS)N)nncHeZdZdZdfd ZdejdejfdZxZS)TanhGatez8Implements a basic learnable gate to scale layer outputsreturnNcttjt jd|_dS)N)super__init__r Parametertorchzerosscale)self __class__s o/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchtune/modules/tanh_gate.pyr zTanhGate.__init__s6 \%+a..11 xc:||jzS)z Args: x (torch.Tensor): input tensor to gate Returns: torch.Tensor: The output tensor after gating. Has the same shape as ``x``. )rtanh)rrs rforwardzTanhGate.forwards4:??$$$$r)rN) __name__ __module__ __qualname____doc__r r Tensorr __classcell__)rs@rrr siBB222222%%%,%%%%%%%%rr)r rModulerrrrsX %%%%%ry%%%%%r