`iZddlZddlZddlZddlZddlmZddlmZej Z ej j j ZejdZdZd.dZdZ d/d Zd0d Z d1d Zd2dZdZ d3dZdZ d/dZ d4dZd5dZd6dZd6dZ d7dZ!d7dZ"d/dZ#d/dZ$d6dZ%d6d Z&d7d!Z'd7d"Z(d/d#Z)d$Z*d/d%Z+d&Z,d6d'Z-d6d(Z.d8d*Z/d8d+Z0d0d,Z1d0d-Z2dS)9N)config)get_plan_cachec|dkrM|tjtjfvr tjS|tjtjfvr tjSn|tjtjfvr+tj|jS|tjkr tjS|tjtjfvr tjS|S)NR2C) npfloat16float32 complex64 complex128dtypecharlowerfloat64)r value_types a/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/cupy/fft/_fft.py _output_dtypersU RZ, , ,<  2<7 7 7= 8 R\2=1 1 18EJ,,..// / bj :  2:rz2 2 2:  Lcpt|j|}||jkr||}|SN)rr astype)ar out_dtypes r_convert_dtyper s6agz22IAG HHY   HrCcj| ||jkr|S|dkr(|d t|}|ddzdz|d<t||D]\}}|||j|krt|j}|||krAtdg|jz}td|||<|t |}ytdg|jz}td||||<|||<t j||jj |} || t |<| }|S)NC2Rrorder) shapelistzipslicendimtuplecupyzerosr r ) rsaxesrr!szaxisr"indexzs r _cook_shaper0's4yALLe!B%"3 GG" Q"4LL  D Nqwt}!4!4MMET{Rt .#Arlld eEllOt .#AuT{33d  d Juagl%@@@"#%,, Hrcxddlm}|dkr|tjkr|jS|dkr|tjkr|jS|dkr|tjkr|jS|dkr|tjkr|j S|dkr|tj kr|j S|dkr|tjkr|j St)NrcufftC2Crr) cupy.cudar3rr CUFFT_C2Cr CUFFT_R2C CUFFT_C2Rr CUFFT_Z2Zr CUFFT_D2Z CUFFT_Z2D ValueError)r rr3s r_convert_fft_typer=>sUu 44 u  "*!4!4 u  ",!6!6 u  "-!7!7 u  "*!4!4 u  "-!7!7rc Bddlm} t|j|} ||jz|jdz kr||d}|j |jjs| }nctj j j s|dkr|s| }n0tj j j r|dkr| }|jd} | dkrtd| ztj j j r>|dkr8d|d_|d|d _n|d zdkrd|d |d zf_|| }|j| z} | } | || }nt'd |t(jsdn t(j}|| | |f}t)j}|=|j}|j}||j|j|dn |jj|dn |jjfz }t=}||}||}n || || | | }|||<n|rtCd|"d|ddf}|#||||<ntI|| j std| |j%krtd||j&krtd||j&| |j'krtdt(j|j(dukrtd|r |dkr|}n.||)||n|*|}| dkr|+||||jd}| | j,ks | | j-kr| }|dkr|| j.kr||z}n4|dkr|t_j0|z}n|dkr|| j1kr||z}||jz|jdz kr||d}|S)Nrr2rrrr41Invalid number of FFT data points (%d) specified.).r).rr.AUse the cuFFT plan either as a context manager or as an argument.)devicesz/multi-GPU cuFFT callbacks are not yet supportedPlan1dz'expected plan to have type cufft.Plan1dcuFFT plan dtype mismatch.z*Target array size does not match the plan.z#Batch size does not match the plan.z/Unclear if multiple GPUs are to be used or not.backwardorthoforward)2r5r3r=r r&swapaxesbaseflags c_contiguouscopyr(cudaruntimeis_hipr"r<imagsizeget_current_plan RuntimeErrorruse_multi_gpus_devicesget_current_callback_managercb_load_aux_arrcb_store_aux_arrcb_loadcb_storedataptrrgetrBNotImplementedError create_plan set_callbacks isinstancefft_typenxbatchgpuscheck_output_arrayget_output_arrayfftr7r: CUFFT_INVERSEmathsqrt CUFFT_FORWARD)r directionrnormr- overwrite_xout_sizeoutplanr3rbnrd curr_planrAkeysmgrload_aux store_auxcache cached_planr,s r _exec_fftr{Qs *55H af} "" JJtR v!5 FFHH I  $ eK FFHH   !jE&9&9 FFHH  A1uu ?! CEE E y+J%$7$7&   AgJOO \Q  )*Ac8q= ! & FaKE&&((I <DD 566 6 |$3H$$(E73133 ?*H,I S[#,"*QQ 0A#+QQ1CE ED  iioo  "DD [<<(E7<KKDE$KK ;)+:;;;??Hd3B3i#899D   d # # #E$KK$ -- HFGG G t} $ $9:: : tw  I%tw00 0 DJ  BCC C  TYd%: ; ;NOO O'zU**  3''''##A&& zz C### 2B5?""h%/&A&A  zi5+>>> r   ty}}   yE,??? r  af} ""ll4$$ Jrc <|D]}t||d||||}|S)Nr4rr)r{)rrmrnr+rorrr-s r_fft_c2cr~s6OO aE4{ N N N Hrr4Fc Jt|tjstd|1|/t |t |krt d|5||j}nt |}dt| dD}nt|}|s|dkr|Std|d}|dvrt d |zt||}t||||}|dkrt|||||| }n|d kr6t|||||d |}t||||dd |}nSt||||dd |}t|j||d |} t|||||d || }|S) N(The input array a must be a cupy.ndarray&Shape and axes have different lengths.cg|]}|Sr).0is r z_fft..s***a***rrr4list index out of rangerErErFrGCInvalid norm value %s, should be "backward", "ortho", or "forward".r}rr)rar(ndarray TypeErrorlenr<r&ranger' IndexErrorrr0r~r{_get_fftn_out_sizer") rr*r+rnrmrrorrdimrps r_fftrs a & &DBCCC D,#a&&CII2E2EABBB | 9&CCa&&C**5#q>>***T{{ 8   H677 7 | 3332489:: :q*%%AAq$ ++AU Q 4{ F F F u   aJd2h L L Q 4crcK @ @ Q 4crcK @ @%agq$r(JGG aJd2h    Hrc|1|/t|t|krtd|A|}nt|}tfdt| dD}|}nt|}|sdSt t | kst t |dz krtd|dkr)ttfd |D}nPtfd |dd D}||d zt|}||fS) zwConfigure axes argument for an n-dimensional FFT. The axes to be transformed are returned in ascending order. Nrcg|]}|zSrr)rrr&s rrz#_prep_fftn_axes..s7771a$h777rr)rrrz/The specified axes exceed the array dimensions.r4cg|]}|zSrrraxr&s rrz#_prep_fftn_axes..s'A'A'AbT 'A'A'Arcg|]}|zSrrrs rrz#_prep_fftn_axes.. s!@!@!@"t)!@!@!@rr) rr<r'r_reduceminmaxsortedappend)r&r*r+rr axes_sorteds` r_prep_fftn_axesrsr D,#a&&CII2E2EABBB | 9CCa&&C7777sdA77788 T{{ 6 3   % %d););dQh)F)FNOO O   'A'A'A'AD'A'A'A B BCCKK!!@!@!@!@d3B3i!@!@!@AAK   tBx$ / / / ,,K  rcdtcxkodkncoBdvp|dz vo7tfdttdz DS)Nrrc3HK|]}|dz|z dkVdS)rNr)rrsrs r z'_nd_plan_is_possible..-sN::!Q'+a.8Q>::::::r)rallr)rr&s` r_nd_plan_is_possibler(s K  % % % %A % % % % :k!>dQh;%> :::::"3{#3#3a#788:::::;rTc Xddlm}t}||j|jfvrd}n||j|jfvrd}nd}|tt|} nt|d||\} } t| |std|d vrtd  fd | D} |d kr | ddd } t| } ||j|jfvr| } | } n:t| } ||| d <t| } ||j |jfvr| } n| } | }| }| tt|kr d}dx}}dx}}nd| vrdtt | }t#d|}|dkr#t#| }t#| }d}d}n|d krd}d}|}|}nx|dz | vrb|t| z }t#| d}|dkr d}d}|}|}n8|d kr"t#| }t#| }d}d}ntd| D]}|dkrtd| |||||||||| d |f }t%j}|=|j}|j}||j|j|dn |jj|dn |jjfz }t5}||}||}nO||j|}|r|||<n;|d|ddf}|||r|||<|S)aFGenerate a CUDA FFT plan for transforming up to three axes. Args: shape (tuple of int): The shape of the array to transform fft_type (int): The FFT type to perform. Supported values are: `cufft.CUFFT_C2C`, `cufft.CUFFT_C2R`, `cufft.CUFFT_R2C`, `cufft.CUFFT_Z2Z`, `cufft.CUFFT_Z2D`, and `cufft.CUFFT_D2Z`. axes (None or int or tuple of int): The axes of the array to transform. Currently, these must be a set of up to three adjacent axes and must include either the first or the last axis of the array. If `None`, it is assumed that all axes are transformed. order ({'C', 'F'}): Specify whether the data to be transformed has C or Fortran ordered data layout. out_size (int): The output length along the last axis for R2C/C2R FFTs. For C2C FFT, this is ignored (and set to `None`). to_cache (bool): Whether to cache the generated plan. Default is ``True``. Returns: plan (cufft.PlanNd): A cuFFT Plan for the chosen `fft_type`. rr2r4rrN)r*r+rzAn n-dimensional cuFFT plan could not be created. The axes must be contiguous and non-repeating. Between one and three axes can be transformed and either the first or last axis must be included in axes.rFzorder must be 'C' or 'F'c g|] }| Srr)rdr"s rrz&_get_cufft_plan_nd..ws000!U1X000rrrrrzzGeneral subsets of FFT axes not currently supported for GPU case (Can only batch FFT over the first or last spatial axes).z,Invalid number of FFT data points specified.PlanNd)r5r3rr6r9r8r;r'rrrr<r#r7r:rr_prodrrVrWrXrYrZr[r\rr]rr_r`)r"rbr+r!rpto_cacher3r&rfft_axes_ in_dimensionsout_dimensionsplan_dimensionsinembedonembednbatchidistodististrideostride min_axis_fftnum_axes_batchrsrurvrwrxryrzrrs` r_get_cufft_plan_ndr1sB.  u::DEOU_555 eou7 7 7   |t%%%dd1;=== 8 $ / /! !! !  J7888&1000x000M ||%ddd+ -((MEOU_555&'m,,  !)N2 ~.. 9 9 9+OO,OGG5t%%%%'' H  "311L5,/00F||m,,n--#  Qhx ' '!CMM1N5.!1!1233F||  #m,,n--!"" " @@ q55>@@ @  Wg 7GU feXb\8 =D  - / /C &(  cl&HM,='Y^-?A A   E))D//K u|T"  E$K$ss)455 $  E$K Krc|dkr"||dd||dz z}n |d}n|dkr||dzdz}nd}|S)Nrrrrrr)in_shaper* last_axisrrps rrrsfU I1R5=HY/!34HHuHH u  I&!+a/ Orc ddlm} tj|} jjrd} njjrd} ntd|dkr|sn0tj j j r|dkr| } | | }|tj| || |}n6t!|| jstd | |jkr(td |j| jjrfd |D} |dkr|| d <nfd |ddd D} t)| } | |jkr.td|j| j| |jkrtd|dkr:|d |jkrtd||jkrtd|r |dkr}n0||| }n|||jdkr|||| | j| jfvrn|t=fd|D}|dkr|| jkr||z}n4|dkr|tAj!|z}n|dkr|| j"kr||z}|S)Nrr2rrza must be contiguousrr4)r+r!rpz'expected plan to have type cufft.PlanNdz+array orders mismatch (plan: {}, input: {})c*g|]}j|Srr"rrrs rrz_exec_fftn..s999bagbk999rrc*g|]}j|Srrrs rrz_exec_fftn..s???bagbk???rzYThe cuFFT plan and a.shape do not match: plan.shape = {}, expected_shape={}, a.shape = {}rDz"The last axis for R2C/C2R mismatchz-The size along the last R2C/C2R axis mismatchr c*g|]}j|Srr)rrarrs rrz_exec_fftn..4s---" " ---rrErFrG)#r5r3r=r rJrK f_contiguousr<rLr(rMrNrOrRrr"rarr!formatr'rbr last_sizergrfrQrhr7r:rrirjrkrl)rrmrrnr+rorrrqrpr3rbr!rtexpected_shaper,rs` @r _exec_fftnrs| *55Hw1  1/000U; FFHH   !jE&9&9 FFHH&&((I |!!'8$e+3555$ -- HFGG G DJ  J$fTZ7799 9 7  @9999D999NU""%-r"@???D2J???N~.. TZ ' 'CCI6JD9D9:: : t} $ $9:: :   Bx4>)) !EFFF4>)) ",---(zU** ##AU#33 3''' x1}} C###EOU_===!!3C ------- . .B zi5+>>> r   ty}}   yE,??? r  JrAc Dt|tjstd|d}|dvrt d|zt |j|||\}} | s|dkr|Stdt||}|dkr5|j j rd}nL|j j rd }n=tj |}d }n&|d vr"t d |t||||| }|jD]} | d krt d| z|d kr!|j j stj |}n&|dkr |j j stj|}t#|j|| d|} t%||||| ||| |  }|S)NrrErrr4rrrrrzUnsupported order: {}r rr?r)rnr+rorrrqrp)rar(rrr<rr&rrrJrrKascontiguousarrayrr0r"asfortranarrayrr) rr*r+rnrmrr!rrrorqrrsrps r_fftnr?s a & &DBCCC | 3332489:: :(4DDD+ 8   H677 7q*%%A || 7  EE W ! EE&q))AEE j 077>>??? Aq$ %888A WII q55CaGII I  ||AG0|  "1 % % #ag2   " ""!'1k"ozJJH1i$[*3$ & & &A Hrcddlm}|}|||}ntdt ||jrt St ||js|jdks tj stS|j j r |dkrtSt|j|||\}}t|dkrvt!||jrat"jjjrDd|dkr+t||jkr|j jrtS|dkrtSt StS)Nrr2r@rr4r)r5r3rRrSrarrrBr&renable_nd_planningrrJrrrrr(rMrNrOrK) rr*r+rrrr3rtrrs r_default_fft_funcrrsV&&((I <DD 566 6$ %% T5< ( ( &A++V6+  w e 3 3 $QVQjAANA{ ;! 4[!& I I 9  # [^##K(8(8AF(B(B,)C U""  KrrcBddlm}t||f|f||jS)aCompute the one-dimensional FFT. Args: a (cupy.ndarray): Array to be transform. n (None or int): Length of the transformed axis of the output. If ``n`` is not given, the length of the input along the axis specified by ``axis`` is used. axis (int): Axis over which to compute the FFT. norm (``"backward"``, ``"ortho"``, or ``"forward"``): Optional keyword to specify the normalization mode. Default is ``None``, which is an alias of ``"backward"``. Returns: cupy.ndarray: The transformed array which shape is specified by ``n`` and type will convert to complex if the input is other. .. seealso:: :func:`numpy.fft.fft` rr2r5r3rrlrrsr-rnr3s rrhrh3(  A4$$(; < <.Os$===!+===rr(asarrayr#rr&raintrollrr+s` rfftshiftr=sp QA |E!&MM"" D#  w 9Q=======t D DDrctj|"ttj}nt |t r|f}tjfd|D|S)a3The inverse of :meth:`fftshift`. Args: x (cupy.ndarray): Input array. axes (int or tuple of ints): Axes over which to shift. Default is ``None``, which shifts all axes. Returns: cupy.ndarray: The shifted array. .. seealso:: :func:`numpy.fft.ifftshift` Nc2g|]}j|dz Srrrs rrzifftshift..ds'@@@4174=A-.@@@rrrs` r ifftshiftrRsp QA |E!&MM"" D#  w 9Q@@@@4@@@$ G GGr)r)NNNr)r4FN)NNr4)NrNT)r4rNFN)NNNr4)NrN)NrN)r)3 functoolsrjnumpyrr(cupy.fftrcupy.fft._cacherreducer_coreinternalprodr_utilmemoizerrr0r=r{r~rrrrrrrrrhrrrrrrrrrrrrrrrr r rrrrrr$sf  ******               .(-1}}}}@    EJ* * * * Z!!!!H;;;HLffffR   .2UUUUpJN!%0 0 0 0 f$$$$N====0====077774777747777477774DDDD4DDDD8>>>>6>>>>:>>>>6>>>>:;;;;4::::0 P P P P B B B B EEEE*HHHHHHr