`ih DddlZddlmZddlmZmZmZmZddlm Z ddl Z ddZ ej j fdeeej ej fdefd Zed ejjejjejjfd ed ed ejdejdejdejf dZdS)N)contextmanager)OptionalListUnionCallablewrapscfd}|S)zCustom caching decorator that uses a provided key function Args: key_fn: Function that generates cache key from the input arguments maxsize: Maximum size of the cache cJitfd}|S)Nc|i|}|vr|S|i|}tkr/tt||<|S)N)lenpopnextiter)argskwargskeyresultcachefunckey_fnmaxsizes _/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/cudnn/graph.pywrapperz/graph_cache..decorator..wrappers}&$)&))Ce||Sz!T4*6**F5zzW$$ $tE{{++,,,E#JMr)rrrrrs` @r decoratorzgraph_cache..decoratorsI t         r)rrrs`` r graph_cachers*$ r heur_modesreturnc Bttsgfd}|S)a Decorator that automatically builds a graph with specified heuristic modes. Args: heur_modes: Single heuristic mode or list of modes for graph building. **kwargs: Additional configuration options for graph building. Returns: Callable: Decorated context manager function that returns (graph, tensor_uids). Example: >>> handle = cudnn.create_handle() >>> @cudnn.jit(heur_modes=[cudnn.heur_mode.A, cudnn.heur_mode.B]) ... def my_graph(): ... with graph(handle) as g: ... X = g.tensor(name="X", dim=[8, 64, 56, 56], ... stride=[56*56*64, 1, 56*64, 64]) ... return g, [X] # Return graph and list of tensors to get UIDs for c@tfd}|S)Nc|i|\}}|dkr||d|DfS)Nrc6g|]}|Sr)get_uid).0ts r z;jit..decorator..wrapper..Es 444qqyy{{444r)get_execution_plan_countbuild)rrgtensorsrr s rrz'jit..decorator..wrapper@s^t.v..JAw))++q00 ###44G4444 4rr)rrr s` rrzjit..decorator?s9 t 5 5 5 5 5  5 r) isinstancelist)r rrs` rjitr0%s?. j$ ' '" \  r cudnn_graphhandlename io_data_typeintermediate_data_typecompute_data_typec#HKtj|||||}|gfVdS)a Context manager for creating and managing a CUDNN graph object. Args: handle: CUDNN handle created with cudnn.create_handle(). name: Name of the graph for debugging purposes. io_data_type: Data type for input/output tensors. compute_data_type: Data type for computation. Yields: Tuple[cudnn.pygraph, List]: (graph object, list of tensors to get UIDs for) )r2r3r4r5r6N)cudnnpygraph)r2r3r4r5r6r,s rgraphr:Ls@(   !5+    A R%KKKKKr)r )r8 contextlibrtypingrrrr functoolsr warningsr heur_modeAr0 data_typeHALFFLOATobjectstrr9r:rrrrFsJ %%%%%%222222222222<AF@Q$$d5?+U_<=$$$$$N$)O$8.3o.C).)>   /"O     ] r