-`iJddlZddlmZddlmZddlmZmZmZdedefdZ dS)N)Callable)wraps)get_kv_transfer_grouphas_kv_transfer_groupis_v1_kv_transfer_groupfuncreturncHddlmtj}t |j} |dn+#t$r}tdj d|d}~wwxYwtfd}|S)zDecorator that handles KV layer transfer prior and after execution of an attention layer, if enabled. Otherwise, the wrapper is a no-op. On entry: waits for the KV layer from the connector. On exit: saves the KV layer to the connector. r)get_attention_context layer_namez Function z# must have a 'layer_name' parameterNc>trts|i|S| } |\}}}t}||s|i|S|||i|}|||||S)N)rrrhas_connector_metadatawait_for_layer_load save_kv_layer) argskwargsr attn_metadata attn_layerkv_cache connectorresultrr layer_name_indexs z/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/attention/utils/kv_transfer_utils.pywrapperz(maybe_transfer_kv_layer..wrapper$s$&& ).E.G.G )4((( (/0 /D.CJ.O.O+ z8)++  (H(H(J(J 4((( ( %%j111t&v&&  HmDDD ) vllm.attention.layerr inspect signaturelist parameterskeysindex ValueError TypeError__name__r)rsig param_nameserr rs` @@rmaybe_transfer_kv_layerr)s;:::::  D ! !Cs~**,,--K&,,\::  J J J J     4[[[. NsA B%A>>B) rcollections.abcr functoolsrvllm.distributed.kv_transferrrrr)rrr.s$$$$$$.(.x......r