`i"ddlmZddlmZmZmZmZddlZddlZddl m Z ddl m Z er ddl mZddlZGddZGd d eZdS) ) annotations)AnyOptional TYPE_CHECKINGUnionN)ir)V)SequenceceZdZdZ d$d%dZd$d&d Zed'd Zed(dZd)dZ d(dZ d*dZ d+dZ d,dZ d+dZd-dZd.d/dZd0d#ZdS)1 KernelInputsz Class to store and provide access to input nodes for kernels. This class takes in a tuple of input nodes and provides methods to access information about these nodes, such as their device type and device. N input_nodes list[Any]scalars&Optional[dict[str, Union[float, int]]]cr||_d|_||ni|_t|dks JddS)z Initialize with a tuple of input nodes. Args: input_nodes: A tuple of input nodes to store Nrz Expected at least one input node) _input_nodes _device_name_scalarslen)selfr rs q/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torch/_inductor/kernel_inputs.py__init__zKernelInputs.__init__sL(+/#*#6B ;!###%G#####reorderOptional[Sequence[int]]returnc|jStjt|ks/Jdtjdt|fd|DS)a7 Return the stored input nodes, optionally reordered. Args: reorder: Optional sequence of indices to reorder the nodes. For example, (2, 0, 1) would return nodes in that order. Returns: The tuple of input nodes, optionally reordered NzReorder length mismatch:  vs c*g|]}j|S)r).0irs r z&KernelInputs.nodes..8s!666!!$666r)rr)rrs` rnodeszKernelInputs.nodes(s} ?$ $4$%%W555 RD,=(>(> R RCLL R R6557666g6666rintc*t|jS)zh Get the number of input nodes. Returns: The number of input nodes )rrrs rcountzKernelInputs.count:s4$%%%r Optional[str]c@tj|jdS)z| Get the device type of the first node. Returns: The device type (e.g., 'cuda', 'cpu') r)rget_device_typerr's r device_typezKernelInputs.device_typeDs!$"3A"6777r torch.devicec@|jdS)zn Get the device of the first node. Returns: The device of the first node r)r get_devicer's rdevicezKernelInputs.deviceOs #..000rc|jJ|}|jdkr+tj|}|j|_|jS)zu Get the device name information. Returns: A tuple of (gpu_name, vendor, model) Ncuda)rr0r,torchr2get_device_properties gcnArchName)rr0device_propertiess r device_namezKernelInputs.device_nameXsR   $[[]]F6))$)J$D$DV$L$L!$5$A!  rtuple[tuple[Any, ...], ...]c>td|jDS)z Get the symbolic shapes of all input nodes. Returns: A tuple of shape tuples for each input node c3>K|]}|VdSN)get_sizer!nodes r z/KernelInputs.shapes_symbolic..ms*CCT]]__CCCCCCrtuplerr's rshapes_symboliczKernelInputs.shapes_symbolicfs$CC1BCCCCCCrtuple[tuple[int, ...], ...]c>td|jDS)z Get the size hints for shapes of all input nodes. Returns: A tuple of shape tuples with integer hints for each input node c3K|]P}tjj|t jjjVQdS)fallbackN) r graphsizevars size_hintsr<r3 _inductorconfigunbacked_symint_fallbackr=s rr?z-KernelInputs.shapes_hinted..vsh   G  ' ' /H (        rr@r's r shapes_hintedzKernelInputs.shapes_hintedo7  )       r%tuple[tuple[sympy.Integer, ...], ...]c>td|jDS)z Get the symbolic strides of all input nodes. Returns: A tuple of stride tuples for each input node c3>K|]}|VdSr;) get_strider=s rr?z0KernelInputs.strides_symbolic..s,EE4T__&&EEEEEErr@r's rstrides_symboliczKernelInputs.strides_symbolic~s$EE43DEEEEEErc>td|jDS)z Get the size hints for strides of all input nodes. Returns: A tuple of stride tuples with integer hints for each input node c3K|]P}tjj|t jjjVQdSrF) r rHrIrJrSr3rKrLrMr=s rr?z.KernelInputs.strides_hinted..sj   G  ' '!!/H (        rr@r's rstrides_hintedzKernelInputs.strides_hintedrOrtuple[torch.dtype, ...]c>td|jDS)zx Get the dtypes of all input nodes. Returns: A tuple of dtypes for each input node c3>K|]}|VdSr;) get_dtyper=s rr?z&KernelInputs.dtypes..s,DD$T^^%%DDDDDDrr@r's rdtypeszKernelInputs.dtypess$DD$2CDDDDDDrridx torch.dtypec@|j|S)z Get the dtype of a specific input node. Args: idx: Index of the node to get the dtype from (default: 0) Returns: The dtype of the specified input node )rr[)rr]s rdtypezKernelInputs.dtypes %//111rnamestrUnion[float, int]cJ||jvsJd|d|j|S)z Get the scalar value for a given name. Args: name: Name of the scalar to get Returns: The scalar value zScalar z not found, but required)r)rras r get_scalarzKernelInputs.get_scalars8t}$$$&N&N&N&N$$$}T""rr;)r rrr)rrrr)rr%)rr))rr-)rr8)rrC)rrP)rrX)r)r]r%rr^)rarbrrc)__name__ __module__ __qualname____doc__rr$propertyr(r,r0r7rBrNrTrWr\r`rer rrr r s_;?HHHHH 77777$&&&X&888X81111 ! ! ! !DDDD     FFFF     EEEE 2 2 2 2 2 # # # # # #rr cDeZdZdZ ddfd ZddZddZddZxZS)MMKernelInputsz Specialized KernelInputs for matrix multiplication operations. Provides additional methods to access M, N, K dimensions. Nr rrrmat1_idxr%mat2_idxct||t|jdks Jd||}}|dkr|t|z }|dkr|t|z }d|cxkrt|ksnJd|d|cxkrt|ksnJd|||_||_dS)z Initialize with a tuple of input nodes. By default, we assume the last 2 input nodes are mat1 and mat2, but the caller can adjust when necessary zExpected at least 2 input nodesrzInvalid mat1_idx: zInvalid mat2_idx: N)superrrr _mat1_idx _mat2_idx)rr rrorpm1_idxm2_idx __class__s rrzMMKernelInputs.__init__s g...4$%%***,M***"8 a<< c+&& &F a<< c+&& &FF----S-------/NH/N/N---F----S-------/NH/N/N---!!rr2tuple[sympy.Integer, sympy.Integer, sympy.Integer]c||j}||j}|d}|d}|d}|d}tjj|||||fS)a Get the symbolic M, N, K dimensions for matrix multiplication. Handles both 2D (MM) and 3D (BMM) tensors. M is extracted from the second-to-last dimension of the first operand (mat1). N is extracted from the last dimension of the second operand (mat2). K is extracted from the last dimension of the first operand (mat1). Returns: A tuple of (M, N, K) dimensions rmrn)r$rtrur<r rHrI check_equals)rmat1mat2mknk0s r mnk_symboliczMMKernelInputs.mnk_symbolicszz||DN+zz||DN+ MMOOB  MMOOB  MMOOB ]]__R  %%a,,,1ayrtuple[Any, Any]c^|}||j||jfS)zj Get the mat1 and mat2 nodes. Returns: A tuple of (mat1, mat2) nodes )r$rtru)rr$s rmat1mat2zMMKernelInputs.mat1mat2s* T^$eDN&;;;rtuple[int, int, int]c|}||j}||j}|d}|d}|d}|d}||ksJd|d||||fS)a  Get the hinted M, N, K dimensions for matrix multiplication. Handles both 2D (MM) and 3D (BMM) tensors. Uses shapes_hinted from the base class to get integer hints for dimensions. Returns: A tuple of (M, N, K) dimensions as integers rmrnzK dimensions don't match: r)rNrtru)r hinted_shapes mat1_shape mat2_shaper~rrk_checks r mnk_hintedzMMKernelInputs.mnk_hinteds**,, "4>2 "4>2 rN rN rNR.G|||J!JJJJ|||1ayr)Nrmrn)r rrrror%rpr%)rry)rr)rr) rfrgrhrirrrr __classcell__)rxs@rrlrls;? """""""@4<<<<rrl) __future__rtypingrrrrr3torch._inductor.configtorch._inductorrtorch._inductor.virtualizedr collections.abcr sympyr rlr rrrs""""""666666666666 ))))))((((((LLLe#e#e#e#e#e#e#e#P`````\`````r