-`iddlZddlmZddlmZmZmZddlmZddl m Z ddl m Z edZ edZee efZe eGd d ZdS) N)field)AnyLiteralget_args) dataclass)config) safe_hash) kv_producerkv_both) kv_consumerr ceZdZUdZdZedzed< dZedzed< dZeed< dZ e ed< dZ e dzed < dZ edzed < d Zeed < d Zeed< dZeed< eeZeeefed< dZedzed< dZeed< dZeded< defdZd dZedefdZedefdZedefdZ defdZ!dS)!KVTransferConfigz0Configuration for distributed KV cache transfer.N kv_connector engine_idcudakv_buffer_devicegeAkv_buffer_sizekv_rolekv_rankkv_parallel_sizez 127.0.0.1kv_ipi8kv_port)default_factorykv_connector_extra_configkv_connector_module_pathFenable_permute_local_kv recompute)rfailkv_load_failure_policyreturncg}tt|d}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)r strencode hexdigest)selffactorshash_strs k/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/config/kv_transfer.py compute_hashzKVTransferConfig.compute_hashHs> S\\0022EJJJTTVVcb|j%ttj|_|jG|jt t vr,td|jdt t |j+|j&tdt t dSdS)NzUnsupported kv_role: z. Supported roles are zEPlease specify kv_role when kv_connector is set, supported roles are ) rr$uuiduuid4rrKVRole ValueErrorrr's r* __post_init__zKVTransferConfig.__post_init__Zs > ! ..DN < # HV;:#L#*###!IsTz   )"c""" NE2"GVd]!!!8GS4Z)c+E3DGSF05d0K0K0KtCH~KKK7+/cDj///%*T)))B;FG$78FFFHc$ RRRRXRVVVVXVVVVVXV@S@@@@@@r,r)r. dataclassesrtypingrrrpydantic.dataclassesrvllm.config.utilsrvllm.utils.hashingr r8r<r0rrMr,r*rSs ))))))))))******$$$$$$(((((( - . - . Z' ( c@c@c@c@c@c@c@ c@c@c@r,