-`i'UddlmZddlmZmZmZddlmZmZm Z m Z ddl m Z ddl mZddlmZddlmZe Gdd Ze ed Gd d eZe ed GddeZe ed GddeZedZedZeezezezZeed<ee GddZdS))Mapping)AnyLiteral TypeAlias) ConfigDictFieldfield_validatormodel_validator) dataclass)config) safe_hash)AttentionBackendEnumc8eZdZUdZeddZeed<dS)BaseDummyOptionsz8Base options for generating dummy data during profiling.r)gecountN)__name__ __module__ __qualname____doc__rrint__annotations__j/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/config/multimodal.pyrrs7BBsq!!!E3!!!!!rrforbid)extraceZdZUdZeddZedzed<eddZedzed<eddZ edzed<dS)VideoDummyOptionsz9Options for generating dummy video data during profiling.Nrgt num_frameswidthheight) rrrrrr#rrr$r%rrrr r sCC"U4A...Jd ...dq)))E3:)))t***FC$J*****rr cheZdZUdZeddZedzed<eddZedzed<dS)ImageDummyOptionsz9Options for generating dummy image data during profiling.Nrr!r$r%) rrrrrr$rrr%rrrr'r's^CCdq)))E3:)))t***FC$J*****rr'c>eZdZUdZeddZedzed<dS)AudioDummyOptionsz9Options for generating dummy audio data during profiling.Nrr!length)rrrrrr*rrrrrr)r)'s;CCt***FC$J*****rr))weightsdata)shmlru DummyOptionsc eZdZUdZeeZeeefe d< dZ e e d< eeZ eeeee ffe d< dZeeefdze d< ed d Zee d < d Zee d< edd Zee d< dZe e d< dZee d< dZedze d< dZe e d< dZe e d< edddZedze d< eddedeeeeeefzfdeeeffdZ eddedeezdzdedzfd Z!e"d!d"Z#defd#Z$d$edefd%Z%d$ede&dzfd&Z'd'e(eefdeeeffd(Z)d)Z*dS)*MultiModalConfigz+Controls the behavior of multimodal models.)default_factorylimit_per_promptFenable_mm_embedsmedia_io_kwargsNmm_processor_kwargsr)defaultrmm_processor_cache_gbr.mm_processor_cache_typemm_shm_cache_max_object_size_mbmm_encoder_onlyr+mm_encoder_tp_modemm_encoder_attn_backendinterleave_mm_stringsskip_mm_profilinggg?)r8rltvideo_pruning_ratebefore)modevaluereturnc|D]o\}}t|trd|i}|dkrtdi|||<4|dkrt di|||<J|dkrt di|||<`t di|||<p|S)Nrvideoimageaudior)items isinstancerr r'r)r)clsrFkvs r_validate_limit_per_promptz+MultiModalConfig._validate_limit_per_prompts KKMM 1 1DAq!S!! !aLG||,11q11ag,11q11ag,11q11a+00a00a rc(t|tr'|dkrtd|t|tr|St|ts Jdt|S)NXFORMERSzwAttention backend 'XFORMERS' has been removed (See PR #29262 for details). Please select a supported attention backend.zDmm_encoder_attn_backend must be a string or an AttentionBackendEnum.)rMstrupper ValueErrorr)rNrFs r!_validate_mm_encoder_attn_backendz2MultiModalConfig._validate_mm_encoder_attn_backends eS ! ! ekkmmz&A&AI  =Ju.BCC=L%%%  R  %$EKKMM22raftercd|jdkr$|jtjkrtd|S)Nr-z]'mm_shm_cache_max_object_size_mb' should only be set when 'mm_processor_cache_type' is 'shm'.)r:r<r1rVselfs r_validate_multimodal_configz,MultiModalConfig._validate_multimodal_configsH  '5 0 0  0? @ @6  rc|j |jjnd|jg}tt |d}|S)a WARNING: Whenever a new field is added to this config, ensure that it is included in the factors list if it affects the computation graph. Provide a hash that uniquely identifies all the configs that affect the structure of the computation graph from input ids/embeddings to the final hidden states, excluding anything before input ids/embeddings and after the final hidden states. NF)usedforsecurity)r?namer>r rTencode hexdigest)r[factorshash_strs r compute_hashzMultiModalConfig.compute_hashsb+7  ( - -  #   S\\0022EJJJTTVVrmodalitycL|j|}|dS|jS)z Get the maximum number of input items allowed per prompt for the given modality (backward compatible). Nr)r3getr)r[re limit_datas rget_limit_per_promptz%MultiModalConfig.get_limit_per_prompts. *..x88  3rc6|j|S)z Get the configurable dummy data options for a modality. Returns None if no options are configured for this modality. )r3rg)r[res rget_dummy_optionsz"MultiModalConfig.get_dummy_optionss $((222rinference_kwargsc8|jpi}|t|zS)z Get the keyword arguments to pass to the multi-modal processor according to the extra arguments passed during inference. )r6dict)r[rlkwargss rmerge_mm_processor_kwargsz*MultiModalConfig.merge_mm_processor_kwargss%)/R-....rc*|jduo |jdkS)Nr)rCrZs ris_multimodal_pruning_enabledz.MultiModalConfig.is_multimodal_pruning_enableds&d2Rt7NQR7RRr)+rrrrrrnr3rTr/rr4boolr5rr6objectr9floatr: MMCacheTyper<rr=r>MMEncoderTPModer?rr@rArCr classmethodrQrWr r\rdrirrkrrprrrrrr1r15sp6505d0K0K0Kd3 ,-KKK#d"""027t1L1L1LOT#tCH~-.LLL<59c6k*T1888$)5q#9#9#95999F,1[000G+05+C+C+C#SCCC"OT!!! +4333 ;<@1D8???W#(4'''.#t### (-uTcc'J'J'J JJJ _'h777cDcN223 c< [87$_.X>>>3..53  $333[?>3"_'"""  #" c*  S  S     3#32BT2I3333 /!#v+. / c6k  / / / /SSSSSrr1N)collections.abcrtypingrrrpydanticrrr r pydantic.dataclassesr vllm.config.utilsr vllm.utils.hashingr #vllm.v1.attention.backends.registryrrr r'r)rwrvr/rr1rrrrsn$######**********HHHHHHHHHHHH******$$$$$$((((((DDDDDD """"""" "  **8,,,---+++++(++.-+ **8,,,---+++++(++.-+ **8,,,---+++++(++.-+ +,l# ((+<