`ifddlZddlZddlZddlmZddlmZddlmZddlmZddl m Z ddl m Z ddl m Z dd l m Z dd l mZdd l mZdd l mZdd l mZddl mZddl mZddlmZddlmZddlmZdaGddZddl mZ ddlmZn#e$redZYnwxYw ddl mZn#e$redZYnwxYwdZdZ de!fdZ"ddl#m$Z$ddl#m%Z%dd l#m&Z&dd!l'm(Z(dd"l'm)Z)dd#l*m+Z+dd$l*m,Z,dd%l*m-Z-dd&l*m.Z.dd'l*m/Z/dd(l*m0Z0dd)l*m1Z1dd*l*m2Z2dd+l*m3Z3dd,l*m4Z4dd-l*m5Z5dd.l*m6Z6dd/l*m7Z7dd0l*m8Z8dd1l*m9Z9dd2l:m;Z;dd3lZ>dd5lZKejJd?ZLdS)AN) get_cuda_path) get_nvcc_path) get_rocm_path)get_hipcc_path)compiler)device)function)memory) memory_hook) memory_hooks) pinned_memory)profiler)stream)texture)driver)runtime)nvrtcceZdZdZdZdS)_UnavailableModuleFc||_dSN)__name__)selfnames f/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/cupy/cuda/__init__.py__init__z_UnavailableModule.__init__s  N)r __module__ __qualname__ availablerrrrrs(Irr)cub)nvtxzcupy.cuda.nvtx)thrustzcupy.cuda.thrustc|dkrddlm}|tj_|S|dkrddlm}|tj_|S|dkrddlm}|tj_|S|dkrdd lm}|tj_|S|d krOtjs!tj dkr ddl mcm }ntd }|tj_ |StfD]}d |jd d}||krKt%jd||jt(t+|t cSt-dt |)Ncusolverr)r&cusparse)r'curand)r(cublas)r)jitifyzcupy.cuda.jitifyz {}_enabled.z cupy.cuda.{} has been deprecated in CuPy v8 and will be removed in the future release. Use {}.available instead. z!module '{}' has no attribute '{}')cupy_backends.cuda.libsr&_cupycudar'r(r)ris_hiprget_build_versioncupy.cuda.jitifyr*rr#formatrsplitwarningswarnDeprecationWarning isinstanceAttributeError)keyr&r'r(r)r*modflags r __getattr__r=0s j444444&   444444&  222222"  222222"  ~ <&":"<"?? $;; MF4..0B D D D"#'9::: : : :  +228SAA C CCrctlda tjdkanQ#t$rD}tjs|jddkrtjrd|jdvrYd}~nd}~wwxYwtS)NFrz5cudaErrorNoDevice: no CUDA-capable device is detectedhipErrorNoDevice) _availablergetDeviceCount Exceptionr0args)es r is_availablerEXs   /11A5JJ   N qvayK(L(L $6afQi$G$G   s# A1:A,,A1returnc(tjS)a Returns the version of the CUDA Runtime installed in the environment. Unlike :func:`cupy.cuda.runtime.runtimeGetVersion`, which returns the CUDA Runtime version statically linked to CuPy, this function returns the version retrieved from the shared library installed on the host. Use this method to probe the CUDA Runtime version installed in the environment. )r_getLocalRuntimeVersionr!rrget_local_runtime_versionrIgs  * , ,,r)Device)get_cublas_handle) get_device_id)Function)Module)alloc) BaseMemory)malloc_managed) malloc_async) ManagedMemory)Memory) MemoryAsync) MemoryPointer) MemoryPool)MemoryAsyncPool)PythonFunctionAllocator)CFunctionAllocator) set_allocator) get_allocator) UnownedMemory) MemoryHook)alloc_pinned_memory) PinnedMemory)PinnedMemoryPointer)PinnedMemoryPool)set_pinned_memory_allocator)Event)get_current_stream)get_elapsed_time)Stream)ExternalStream)Graphc#K| tj}tj}tj| dVtj|dS#tj|wxYw)aSets a thread-local allocator for GPU memory inside context manager Args: allocator (function): CuPy memory allocator. It must have the same interface as the :func:`cupy.cuda.alloc` function, which takes the buffer size as an argument and returns the device buffer of that size. When ``None`` is specified, raw memory allocator will be used (i.e., memory pool is disabled). N)r _malloc_get_thread_local_allocator_set_thread_local_allocator) allocatorprevious_allocators rusing_allocatorrpssN ;== &y111? *+=>>>>>*+=>>>>s AA)c#Ktjdtj dVtjdS#tjwxYw)a#Enable CUDA profiling during with statement. This function enables profiling on entering a with statement, and disables profiling on leaving the statement. >>> with cupy.cuda.profile(): ... # do something you want to measure ... pass .. note:: When starting ``nvprof`` from the command line, manually setting ``--profile-from-start off`` may be required for the desired behavior. .. warning:: This context manager is deprecated. Please use :class:`cupyx.profiler.profile` instead. z{cupy.cuda.profile has been deprecated since CuPy v10 and will be removed in the future. Use cupyx.profiler.profile instead.N)r5r6rstartstopr!rrprofilerts^$ M   N   s AAr)M contextlibr5cupyr.cupy._environmentrrrr cupy.cudarrr r r r r rrrcupy_backends.cuda.apirrr-rr@rr"r# ImportErrorr$r=rEintrIcupy.cuda.devicerJrKrLcupy.cuda.functionrMrNcupy.cuda.memoryrOrPrQrRrSrTrUrVrWrXrYrZr[r\r]cupy.cuda.memory_hookr^cupy.cuda.pinned_memoryr_r`rarbrccupy.cuda.streamrdrerfrgrhcupy.cuda.graphricontextmanagerrprtr!rrrs++++++++++++++++++,,,,,,!!!!!!""""""######))))))******)))))) 0,,,,,,,000  . / /DDD04       444   2 3 3FFF4%C%C%CP    -3 - - - -$#####......******''''''%%%%%%""""""''''''++++++))))))******######((((((******'''''',,,,,,444444//////******************,,,,,,777777000000777777444444??????""""""//////------######++++++!!!!!! ????. s$ BB#"B#'B..CC