.`iZdZddlmZddlmZGddeZGddeZdS) z Kimi-K2.5 Model Configuration. This configuration supports video-chunk as an internal modality type. A video-chunk is the smallest independently processable unit of video. )DeepseekV3Config)PretrainedConfigc!eZdZdZ d"dedededededededededeeefdededededzded ef fd! ZxZ S)#KimiK25VisionConfigkimi_k25_vision@ divided_fixedrspatial_temporal sd2_tpool patchmergerNgeluh㈵> patch_sizeinit_pos_emb_heightinit_pos_emb_widthinit_pos_emb_time pos_emb_typenum_attention_headsnum_hidden_layers hidden_sizeintermediate_sizemerge_kernel_sizevideo_attn_type merge_typemm_projector_typemm_hidden_sizeprojector_hidden_actprojector_ln_epsc .tjdi|||_||_||_||_||_||_||_||_ | |_ | |_ | |_ | |_ | |_|||_n||_||_||_dS)N)super__init__rrrrrrrrrr r!r"r#r$r%r&)selfrrrrrrrrrr r!r"r#r$r%r&kwargs __class__s |/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/transformers_utils/configs/kimi_k25.pyr*zKimiK25VisionConfig.__init__s, ""6"""$#6 "4!2(#6 !2&!2!2.$!2  %"0D  "-D $8! 0)rr r r r r r rrrrrrNrr) __name__ __module__ __qualname__ model_typeintstrtuplefloatr* __classcell__r-s@r.rrs%"J #%"$!"+#%!#!%-31%!.%)$*"&'+1+1+1! +1  +1  +1+1!+1+1+1+1!c?+1+1+1 !+1"d #+1$"%+1& '+1+1+1+1+1+1+1+1+1+1r/rceZdZdZdZ dd eezdzd eezdzd ed ed ede de ffd Z e defdZ e defdZxZS) KimiK25Configa*Kimi-K2.5 model configuration. Kimi-K2.5 extends Kimi-K2 with vision support using video-chunks. A video-chunk consists of multiple consecutive frames that are processed together with temporal pooling. Args: vision_config: Configuration for the vision tower and projector. text_config: Configuration for the text model (DeepseekV3). ignore_index: The ignore index for the loss function. media_placeholder_token_id: The token ID for media placeholders. pad_token_id: The token ID for padding. kimi_k25NrF<|kimi_k25_video_placeholder|> vision_config text_config ignore_indexmedia_placeholder_token_id pad_token_iduse_unified_vision_chunkvideo_placeholderc |t}n!t|tr tdi|}||_|t }n!t|tr t di|}||_|jj|jjkr|jj|j_||_||_ ||_ ||_ t|jdd|jj |_ tjdd|i|dS)Nquantization_configrDr()r isinstancedictr@rrAr$rrBrCrErFgetattrrHr)r*) r+r@rArBrCrDrErFr,r-s r.r*zKimiK25Config.__init__Ps"  /11MM  t , , A/@@-@@M2?  *,,KK  T * * :*99[99K-8   ,0B0N N N040@0LD  -)*D'(@%!2 4#%:D A A M'+'7'KD $==l=f=====r/returnc|jjS)z3Get hidden size from text config for compatibility.)rArr+s r.rzKimiK25Config.hidden_sizeys++r/c|jjS)z2Get vocab size from text config for compatibility.)rA vocab_sizerNs r.rPzKimiK25Config.vocab_size~s**r/)NNr=r>rFr?)r0r1r2__doc__r3rJrrr4boolr5r*propertyrrPr8r9s@r.r;r;?s  J<@6: *0).!A'>'>11D8'>,,t3'> '> %( '>  '>#''>'>'>'>'>'>'>R,S,,,X,+C+++X+++++r/r;N)rQ transformersr transformers.configuration_utilsrrr;r(r/r.rVs*)))))======.1.1.1.1.1*.1.1.1bB+B+B+B+B+$B+B+B+B+B+r/