.`i:ddlZddlZddlmZddlmZmZmZmZm Z ddl m Z m Z m Z mZddlmZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZerdd lm Z edeeZ!edeeZ"Gdde#Z$Gdde%Z&de'e(e'dfzfdZ)ede'de*e+fdZ,ddde'e(e'dfzfdZ-ddedd e+d!ed"e+dzd#e.de'e!e(e'e!dfzd$ede!fd%Z/ee/Z0ed&e!de*e+fd'Z1ddedd e+d!ed"e+dzd#e.de'e!e(e'e!dfzd$ede!fd(Z2efddde'e!e(e'e!dfzd$ede!fd)Z3ddd*d e+d!ed"e+dzd#e.d$ef d+Z4ee4Z5ddd$efd,Z6ddd*d e+d!ed"e+dzd#e.d$ef d-Z7ee7Z8ddd$efd.Z9dddd/d e+d!ed"e+dzd#e.d0e'e"dzd$ef d1Z:ee:Z; d3ddde'e"dzd$efd2Zr:r=r;r<)setradd)r8dynamic_kwargskwargs_type_annotationskw_typekw_annotationskw_names r$,_collect_dynamic_keys_from_processing_kwargsrE=s"uuN-Z88T,, - - -+,CG,LMMN) , ,""7++++WWWWN r& model_configrc l|}||}t|}t||dd}|D]S\}}t |t rt|||<t |trt|||<T|S)NFT)requires_kw_onlyallow_var_kwargs) get_multimodal_configmerge_mm_processor_kwargsr7rr!r5dictrlistr/) rFr2kwargs mm_config merged_kwargsfactoryallowed_kwargskeyvalues r$_merge_mm_kwargsrUNs 2244I77??M' 66G5 N%**,,66 U eT " " 6".u"5"5N3  eT " " 6".u"5"5N3  r&Frevisiontrust_remote_coder2processor_nameargsrWrXrNc|d} t|}t|ts |tkrt j|g|R||d|}n2t |tr|j|g|R||d|}n||i|}n(#t$r}|sd}t|||d}~wwxYwt||s"td|dt||S)z:Load a processor for the given model name via HuggingFace.NmainrWrXzFailed to load the processor. If the processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.z6Invalid type of HuggingFace processor. Expected type: z, but found type: ) rr5r1rr r4 issubclass ValueError RuntimeError TypeErrortype) rYrWrXr2rZrN processoreerr_msgs r$ get_processorrfjs#3NCC mU + + 7}/N/N%5""3   II ~ 6 6 75 5""3   II& t6v66I ! 9 w''Q .G i / /  -+ - - ?? - -   sA:B B& B!!B&rccB tjt|jjd}|r|jnd}|dtjfvr"tt|dSt|j }tj |}t}t|D],\}}|dr|t|z}-|S#t"$rtcYSwxYw)NrNrProcessingKwargs)inspect signaturerb__call__ parametersget annotation_emptyrErr) importlib import_moduler>varsr!endswith Exception)rc call_kwargscall_kwargs_annotations module_namemodprocessor_kwargsnameobjs r$#get_processor_kwargs_from_processorr|s0'Y(@AALPP   =H"Q+"8"8T "4*@ @ @ @011!4  y//4K)+66C), !#YY__..   c==!344(FsKKL%$ # uu sA:D=BDDDc t||||}t| fd|D}t|f|||d|}|S)NrVc$i|] \}}|v || Sr-r-).0kv dynamic_keyss r$ z?cached_get_processor_without_dynamic_kwargs..s)PPP1!<:O:Oq!:O:O:Or&)cached_get_processorr|r!) rYrWrXr2rZrNrcfiltered_kwargsfinal_processorrs @r$+cached_get_processor_without_dynamic_kwargsrs%+# I7yAALQPPP PPPO++#   O r&c t|jr-t|jr Jd|j}|j}n|j}|j}t |f||j|dt||fi|S)Nz^For multimodal GGUF models, the original tokenizer should be used to correctly load processor.rV)rmodel tokenizertokenizer_revisionrWrrXrU)rFr2rNrrWs r$cached_processor_from_configrs |!"" )<122   :  2&2"( 6  &8#    < A A& A A   r&r]c t|}tj|g|R||d|}n(#t$r}|sd}t |||d}~wwxYwt t |S)zMLoad an audio feature extractor for the given model name via HuggingFace.r]zFailed to load the feature extractor. If the feature extractor is a custom extractor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rr r4r_r`rr )rYrWrXrZrNfeature_extractorrdres r$get_feature_extractorrs3NCC0@    /       ! 9 w''Q .G &(9 : ::'* AA  Ac bt|jf|j|jdt |t fi|S)Nr])cached_get_feature_extractorrrWrXrUr )rFrNs r$$cached_feature_extractor_from_configr+sO ( &&8   <)= H H H H   r&c t|}tj|g|R||d|}n(#t$r}|sd}t |||d}~wwxYwt t |S)zALoad an image processor for the given model name via HuggingFace.r]zFailed to load the image processor. If the image processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rr r4r_r`rr)rYrWrXrZrNrcrdres r$get_image_processorr7s3NCC&6    /       ! 9 w''Q .G "I . ..rc t|jr-t|jr Jd|j}|j}n|j}|j}t |f||jdt|tfi|S)NzdFor multimodal GGUF models, the original tokenizer should be used to correctly load image processor.r]) rrrrrWcached_get_image_processorrXrUr )rFrNrrWs r$"cached_image_processor_from_configr^s|!"" )<122   @  2&2"( %  &8   <); F Fv F F   r&rWrXprocessor_cls_overridesrc t|}|pt}|j|g|R||d|}n(#t$r}|sd} t | ||d}~wwxYwt t |S)z@Load a video processor for the given model name via HuggingFace.r]zFailed to load the video processor. If the video processor is a custom processor not yet available in the HuggingFace transformers library, consider setting `trust_remote_code=True` in LLM or using the `--trust-remote-code` flag in the CLI.N)rr r4r_r`rr) rYrWrXrrZrNr2rcrdres r$get_video_processorrts3NCC/E3E 1M1    /       ! 9 w''Q .G "I . ..s,/ AAAc dt|jf|j|j|dt |t fi|S)Nr)cached_get_video_processorrrWrXrUr )rFr2rNs r$"cached_video_processor_from_configrsR & &&8 -    <); F Fv F F   r&r)=rpri functoolsrtypingrrrrr transformersr r r r %transformers.feature_extraction_utilsr #transformers.image_processing_utilsrtransformers.processing_utilsr#transformers.video_processing_utilsrtyping_extensionsr"vllm.transformers_utils.gguf_utilsrvllm.transformers_utils.utilsrvllm.utils.func_utilsr vllm.configrrrrLrrMr/rbr1r7r>strrErUboolrfrr|rrrrrrrrrrrr-r&r$rsEEEEEEEEEEEEEE IHHHHHBBBBBB888888BBBBBB%%%%%%666666DDDDDDBBBBBB('''''' WT@@@ WT+5GHHH-----4---!!!!!4!!!TE$)4D-D  T c#h      %c **> #5C 7777 7Dj7 7 8eDHcM22 7  77777t!y// 2#c( H #5C  Dj  8eDHcM22   H6D8eDHcM22 8 # !;!;!;!; !;Dj!; !;  !;!;!;!;H )y)>??       # !/!/!/!/ !/Dj!/ !/  !/!/!/!/H'Y':;;2 #/3 #/#/#/#/ #/Dj#/ #/ ""X_ #/  #/#/#/#/L'Y':;; &*   8d?       r&