.`i, UddlmZddlmZmZmZmZmZmZddl Z ddl m Z m Z m Z mZer ddlmZmZmZneZeZeZGdde ZGdd e ZGd d e ZGd d e ZeezezezZeed< dede efdZdede efdZedeedZedeedZGdde eeefZeezZ eed< Gdde Z! d4de"e#dedzde!fdZ$Gdd e Z% d4d!e j&dedzde%fd"Z'e!e%zezZ(eed#< Gd$d%e Z)e!e%zezZ*eed&< e(e)zZ+eed'< ed(ee)Z,ed*ee)Z- d4d+e,d,e-dzd-e.eefdzdee,e-ffd.Z/ d4d/ee,d0ee-dzd-ee.eefe.eefzdzde"ee,e-ffd1Z0d2eee,e-fde"e1e,e-dzffd3Z2dS)5)Iterable) TYPE_CHECKINGAnyGenericLiteral TypeAliascastN) NotRequired TypedDictTypeIsTypeVar)MultiModalDataDictMultiModalInputsMultiModalUUIDDictceZdZUdZeed< eedzed< eeee fdzed< ee ed< eeed<dS) TextPromptzSchema for a text prompt.promptNmulti_modal_datamm_processor_kwargsmulti_modal_uuids cache_salt) __name__ __module__ __qualname____doc__str__annotations__r rdictrrd/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/inputs/data.pyrrs## KKKE!"4t";<<<< %T#s(^d%:;;;;##56666C    r rceZdZUdZeeed< eeed< eeeed< ee dzed< ee ee fdzed< ee ed< eeed <dS) TokensPromptzSchema for a tokenized prompt.prompt_token_idsrtoken_type_idsNrrrr) rrrrlistintrr rrrrrrr r!r#r#8s((3i3  GS ****F!"4t";<<<< %T#s(^d%:;;;;##56666C    r r#c@eZdZUdZejed< eeed<dS) EmbedsPromptz2Schema for a prompt provided via token embeddings. prompt_embedsrN) rrrrtorchTensorrr rrr r!r)r)`s><<<'C    r r)c*eZdZUdZeed< eed<dS) DataPromptz:Represents generic inputs handled by IO processor plugins.data data_formatN)rrrrrrrrr r!r.r.ls0DD IIIr r.SingletonPromptrreturnc<t|tod|vod|vSNr$r* isinstancerrs r!is_tokens_promptr8s.64   * & ( * 6 )r c<t|tod|vod|vSr4r5r7s r!is_embeds_promptr:s.64   & f , & v %r _T1_coT)bounddefault covariant_T2_cocTeZdZUdZeed<edzed<eee e fed<dS)ExplicitEncoderDecoderPromptaw Represents an encoder/decoder model input prompt, comprising an explicit encoder prompt and a decoder prompt. The encoder and decoder prompts, respectively, may be formatted according to any of the [`SingletonPrompt`][vllm.inputs.data.SingletonPrompt] schemas, and are not required to have the same schema. Only the encoder prompt may have multi-modal data. mm_processor_kwargs should be at the top-level, and should not be set in the encoder/decoder prompts, since they are agnostic to the encoder/decoder. Note that an [`ExplicitEncoderDecoderPrompt`][vllm.inputs.data.ExplicitEncoderDecoderPrompt] may not be used as an input to a decoder-only model, and that the `encoder_prompt` and `decoder_prompt` fields of this data structure themselves must be [`SingletonPrompt`][vllm.inputs.data.SingletonPrompt] instances. encoder_promptNdecoder_promptr) rrrrr;rr?r rrrrr r!rArAsS*TM!!!$T#s(^444444r rA PromptTypecZeZdZUdZeded< eeed< ee ed<dS) TokenInputszRepresents token-based inputs.tokentyper$rN) rrrrrrr&r'r rrr r!rFrFsT(( ' 3i&C    r rFr$rc6td|}|||d<|S)zQConstruct [`TokenInputs`][vllm.inputs.data.TokenInputs] from optional values.rG)rHr$Nr)rF)r$rinputss r! token_inputsrKs, g8H I I IF)| Mr cXeZdZUdZeded< ejed< ee ed<dS) EmbedsInputsz#Represents embeddings-based inputs.embedsrHr*rN) rrrrrrr+r,r rrr r!rMrMsR-- ( <'C    r rMr*c6td|}|||d<|S)zSConstruct [`EmbedsInputs`][vllm.inputs.data.EmbedsInputs] from optional values.rN)rHr*Nr)rM)r*rrJs r! embeds_inputsrPs+ x} E E EF)| Mr DecoderOnlyInputsc6eZdZUdZeezed< eezed<dS)EncoderDecoderInputsz The inputs in [`LLMEngine`][vllm.engine.llm_engine.LLMEngine] before they are passed to the model executor. This specifies the required data for encoder-decoder models. encoderdecoderN)rrrrrFrrrr r!rSrSsE+ ++++- + ++++--r rSSingletonInputsProcessorInputs_T1)r<r=_T2rBrCrc.|i}t|||S)NrBrCr)rAr[s r!build_explicit_enc_dec_promptr\2s0 "  '%%/   r enc_prompts dec_promptsc'ttttfit trfdt ||DSdt ||DS)a Zip encoder and decoder prompts together into a list of [`ExplicitEncoderDecoderPrompt`][vllm.inputs.data.ExplicitEncoderDecoderPrompt] instances. `mm_processor_kwargs` may also be provided; if a dict is passed, the same dictionary will be used for every encoder/decoder prompt. If an iterable is provided, it will be zipped with the encoder/decoder prompts. Nc g|];\}}t||ttttfz'zip_enc_dec_prompts..QsU   1 *T#s(^%899     r c8g|]\}}}t|||Sr)r\)rarBrCmm_proc_kwargss r!rbz'zip_enc_dec_prompts..Ys:    <^^^ &nnnUU   r )r rrrr6zip)r]r^rs `r!zip_enc_dec_promptsrf@s""4S>266%t,,     58 [4Q4Q       @C &9A A    r enc_dec_promptscd|DS)Nc.g|]}|d|dfS)rBrCr)raenc_dec_prompts r!rbz)to_enc_dec_tuple_list..ds9     ( )>:J+KL   r r)rgs r!to_enc_dec_tuple_listrkas#  -   r )N)3collections.abcrtypingrrrrrr r+typing_extensionsr r r r vllm.multimodal.inputsrrrobjectrr#r)r.rr1rr8r:r;r?rArDrFr&r'rKrMr,rPrQrSrVrWrXrYrr\rftuplerkrr r!rrs5%$$$$$$HHHHHHHHHHHHHHHH EEEEEEEEEEEE            F%%%%%9%%%P     9           !:- <|KKKK0_ 1E_ 1E  O_     O_    555559gffn.E555:(*FF IFFF      )   ""  3i d           9   ""  < d       +\9