-`iddlZddlZddlmZddlmZmZmZddlm Z ddl m Z edZ edZ ee e fZe e Gdd ZdS) N)field)AnyLiteralget_args) dataclass)config ec_producer ec_consumerceZdZUdZdZedzed< dZedzed< dZedzed< dZ e ed< dZ e dzed < dZ edzed < d Zeed < d Zeed< dZeed< eeZeeefed< dZedzed< defdZddZedefdZedefdZedefdZdefdZdS)ECTransferConfigz0Configuration for distributed EC cache transfer.N ec_connector engine_idcudaec_buffer_devicegeAec_buffer_sizeec_roleec_rankec_parallel_sizez 127.0.0.1ec_ipi8ec_port)default_factoryec_connector_extra_configec_connector_module_pathreturncg}tjt|d}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. F)usedforsecurity)hashlibmd5strencode hexdigest)selffactorshash_strs k/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/config/ec_transfer.py compute_hashzECTransferConfig.compute_hash?s@ ;s7||2244eLLLVVXXcb|j%ttj|_|jG|jt t vr,td|jdt t |j+|j&tdt t dSdS)NzUnsupported ec_role: z. Supported roles are zEPlease specify ec_role when ec_connector is set, supported roles are ) rr uuiduuid4rrECRole ValueErrorr r#s r& __post_init__zECTransferConfig.__post_init__Qs > ! ..DN < # HVr(r&r r s;:#L#*###!IsTz   )#)cDj)))& NE2"GVd]!!!)GS4Z)c*E3DGSF05d0K0K0KtCH~KKK7+/cDj///c$ RRRRXRVVVVXVVVVVXV@S@@@@@@r(r )rr* dataclassesrtypingrrrpydantic.dataclassesrvllm.config.utilsrr4r8r,r rIr(r&rNs ))))))))))******$$$$$$ ] # ] # Z' ( [@[@[@[@[@[@[@ [@[@[@r(