-`i UddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z m Z ddl m Z ddl mZddlmZddlmZddlmZmZmZmZddlZdd lmZmZmZdd lmZddlm Z dd l!m"Z"dd l#m$Z$m%Z%dd l&m'Z'ddl(m)Z)ddl*m+Z+ddl,m-Z-ddl.m/Z/ddl0m1Z1m2Z2m3Z3ddl4m5Z5ddl6m7Z7ddl8m9Z9ddl:m;Z;ddlm?Z?ddl@mAZAddlBmCZCddlDmEZEddlFmGZGddlHmIZIddlJmKZKdd lLmMZMdd!lNmOZOmPZPerdd"lQmRZRdd#lSmTZTdd$lUmVZVneZReZTeZVe%eWZXGd%d&eZYd'ZZd'Z[d(d)d*e\fd+Z]d(d)d*e\fd,Z^d-d'd'd'd'd'd'd'd.e3j_d'd/iZ`d-d0e]e^d'd'd'd'd.e3jad'd/iZbd-d0e]e^d'eZe[e[d.e3jcd'd/iZdd-d0e]e^d'eZe[e[d.e3jcd'd/iZeeYjfe`eYjgebeYjhedeYjieeiZjePeed012Gd3d)Zkdalekdzemd4<daneodzemd5<e dAd6ekd7eodzfd8Zped9d:Zqd*ekfd;Zrd*ekdzfd<Zsed=Zt dBd6ekd>euetd?eveodzd*eweoetffd@ZxdS)CN)contextmanager) is_dataclassreplace)datetime)IntEnum) lru_cache)Path) TYPE_CHECKINGAnyTypeVarget_args) ConfigDictFieldmodel_validator) dataclass)EagleModelTypes)enable_trace_function_call init_logger)is_runai_obj_uri) random_uuid) safe_hash)AttentionConfig) CacheConfig)CompilationConfigCompilationMode CUDAGraphMode) DeviceConfig)ECTransferConfig)KVEventsConfig)KVTransferConfig) LoadConfig) LoRAConfig) ModelConfig)ObservabilityConfig)ParallelConfig)ProfilerConfig)SchedulerConfig)SpeculativeConfig)StructuredOutputsConfig) SupportsHashconfig)PretrainedConfig)QuantizationConfig) KVCacheConfigc(eZdZdZdZ dZ dZ dZdS)OptimizationLevelzOptimization level enum.rrN)__name__ __module__ __qualname____doc__O0O1O2O3d/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/config/vllm.pyr1r1?s7"" B2 B BO B))r=r1Fcfg VllmConfigreturncj|jdp|jdS)zbEnable if either RMS norm or quant FP8 custom op is active; otherwise Inductor handles fusion.rms_norm quant_fp8compilation_configis_custom_op_enabledr?s r>enable_norm_fusionrIXs=  ! 6 6   B  4 4[ A ABr=cj|jdp|jdS)zbEnable if either SiLU+Mul or quant FP8 custom op is active; otherwise Inductor handles fusion. silu_and_mulrDrErHs r>enable_act_fusionrLas=  ! 6 6   B  4 4[ A ABr=rF)eliminate_noopsfuse_norm_quantfuse_act_quantfuse_allreduce_rmsfuse_attn_quant enable_spfuse_gemm_comms) pass_configcudagraph_modeuse_inductor_graph_partitionT)arbitrary_types_allowed)r,ceZdZUdZedZeed< eeZ eed< ee Z e ed< ee j Ze ed< eeZeed < eeZeed < eeZeed < dZedzed < dZedzed < eeZeed< eeZeed< dZedzed< eeZ eed< ee!Z"e!ed< dZ#e$dzed< dZ%e&dzed< dZ'e(dzed< ee)Z*e)e+zed< dZ,e-ed< e.j/Z0e.ed< de-fdZ1de2de2fdZ3e4de5fdZ6d8dZ7e8ded ededzfd Z9e8ded ededzfd!Z: d9d"e;d#ed&e-d'e>ddfd(Z?d)e)e-e>fddfd*Z@d8d+ZAd,ZBd-e