)`i ddlmZddlmZddlZddlZddlmZ d dejdeejdeejdeej d ejf d Z dS) )Mapping)OptionalN)silu_and_mul_kernelxx_scaleo_scaledtypereturnc  |j\}|dzdksJ|dz |p|j}tj f||j}dt t tfdtttff fd }t||| d||| d| d|du|du |S) aSigmoid Linear Unit and Multiplication Computes `silu(x[:,:d]) * x[:, d:]`, where `d = x.shape[-1] // 2. If the scale of `x` is `x_scale`, the scale applied to the output is the square of that, as the sigmoid function ranges in (0, 1). Args: x: The input tensor, of shape `(b, 2 * d)`. x_scale: An optional scale which was applied to `x`. o_scale: The scale to apply to the output. dtype: The desired output dtype. Returns: The output activation, of shape `(b, d)`. r)r devicemetar c>tj|dfS)N BLOCK_SIZE)tritoncdiv)rbds p/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/flashinfer/triton/activation.pygridzsilu_and_mul..grid)s6;q$|"45566iN) o_ptro_stride o_scale_ptrx_ptrx_stride x_scale_ptrrr HAS_X_SCALE HAS_O_SCALE) shaper torchemptyr rstrinttuplerstride) rrrr no_dtypeorrrs @@r silu_and_mulr* s. 7DAq q5A:::: QAqwG QF'!(;;;A7738$7sCx7777777!! 4'4'     Hr)NNN) collections.abcrtypingrr!r$flashinfer.triton.kernels.activationrTensorr r*rrr0s###### DDDDDD '+&*#' / /  |/ el #/ el #/  EK /  \ / / / / / / r