.`iPUddlZddlmZmZmZddlmZmZmZm Z m Z m Z m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZmZmZmZddlmZddlmZ ddlm!Z"ddl#m$Z$ddl%m&Z' dd lm(Z(n#e)$r dd lm*Z(YnwxYwdd l+m,Z,m-Z-dd l.m/Z0dd l1m2Z2m3Z3ddl4m5Z5m6Z6m7Z7m8Z8ddl9m:Z:ddl;mZ>ddl?m@Z@ddlAmBZBmCZCmDZDddlEmFZFe@eGZHGdde<ZIGdde<ZJGdde<ZKdZLdZMGdde<ZNeOe:eOeNzZPeeQd<eezZReeQd <Gd!d"e<ZSGd#d$e<ZTGd%d&e<ZUGd'd(e<ZVGd)d*eZGd+d,e ZGd-d.e"Z!ee!zezezeze ze zezezeVzeUze zezezezezeze zezezezezezZWeeQd/<dS)0N)AnyLiteral TypeAlias))ResponseCodeInterpreterCallCodeDeltaEvent(ResponseCodeInterpreterCallCodeDoneEvent)ResponseCodeInterpreterCallCompletedEvent*ResponseCodeInterpreterCallInProgressEvent,ResponseCodeInterpreterCallInterpretingEventResponseContentPartAddedEventResponseContentPartDoneEventResponseFunctionToolCallResponseInputItemParam"ResponseMcpCallArgumentsDeltaEvent!ResponseMcpCallArgumentsDoneEventResponseMcpCallCompletedEventResponseMcpCallInProgressEventResponseOutputItemResponseOutputItemAddedEventResponseOutputItemDoneEventResponsePromptResponseReasoningTextDeltaEventResponseReasoningTextDoneEventResponseStatus#ResponseWebSearchCallCompletedEvent$ResponseWebSearchCallInProgressEvent#ResponseWebSearchCallSearchingEvent)ResponseCompletedEvent)ResponseCreatedEvent)ResponseInProgressEvent)Tool)Message)ResponseTextConfig)ResponseFormatTextConfig)IncompleteDetails ToolChoice)Content)Metadata Reasoning)FieldValidationErrorfield_serializermodel_validator)ChatCompletionMessageParam)OpenAIBaseModel)VLLMValidationError) init_logger)RequestOutputKindSamplingParamsStructuredOutputsParams random_uuidcveZdZUeed<eeZeeed<eeZeeed<dS)InputTokensDetails cached_tokensdefault_factoryinput_tokens_per_turncached_tokens_per_turnN) __name__ __module__ __qualname__int__annotations__r)listr;r<~/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/entrypoints/openai/responses/protocol.pyr7r7Nsb',uT'B'B'B49BBB(-d(C(C(CDICCCCCrDr7ceZdZUdZeed<dZeed<eeZ eeed<eeZ eeed<dS)OutputTokensDetailsrreasoning_tokenstool_output_tokensr9output_tokens_per_turntool_output_tokens_per_turnN) r=r>r?rHr@rArIr)rBrJrKrCrDrErGrGTsxc(-d(C(C(CDICCC-2U4-H-H-HcHHHHHrDrGcBeZdZUeed<eed<eed<eed<eed<dS) ResponseUsage input_tokensinput_tokens_details output_tokensoutput_tokens_details total_tokensN)r=r>r?r@rAr7rGrCrDrErMrM[sN,,,,....rDrMct|tr|St|dr|S|S)z% Serializes a single message to_dict) isinstancedicthasattrrTmodel_dump_json)msgs rEserialize_messagerZcsO#t% i %{{}}""$$$rDc"|r d|DndS)z& Serializes multiple messages c,g|]}t|SrC)rZ).0rYs rE z&serialize_messages..ts! 3 3 3s c " " 3 3 3rDNrC)msgss rEserialize_messagesr`ps#8< E 3 3d 3 3 3 3ErDcNeZdZUdZeed<eeed<dZe ded<dS)ResponseRawMessageAndTokenz]Class to show the raw message. If message / tokens diverge, tokens is the source of truthmessagetokensraw_message_tokenstypeN) r=r>r?__doc__strrArBr@rfrrCrDrErbrbwsOBBLLL I*>D'& '>>>>>rDrbResponseInputOutputMessageResponseInputOutputItemcxeZdZUdZedzed<dZeedfdzed<e ee zed<dZ e dzed<dZ e dzed<dZe dzed <dZedzed <dZe dzed <dZee efdzed <d Zedzed<dZe dzed<dZedzed<dZedzed<dZeded<d Zedzed<dZedzed<dZedzed<dZe dzed<dZ!e"ed<e#eZ$ee%ed<dZ&e dzed<dZ'edzed<dZ(e dzed<d Z)ed!dzed"<dZ*e dzed#<d Z+eed$<dZ,eed%<e#dd&'Z-e dzed(<e#d)d*+Z.e ed,<e#dd-'Z/ee e0fdzed.<e#dd/'Z1e ed0<e#dd1'Z2e dzed2<e#dd3'Z3eed4<dZ4ee5ezdzed5<d6d6dd7Z6 dCd8e d9edzd:e7fd;Z8d:efd<Z9e:d=>d?Z;e:d=>d@Z<e:d=>dAZ=e:d=>dBZ>dS)DResponsesRequestFN background)zcode_interpreter_call.outputsz%computer_call_output.output.image_urlzfile_search_call.resultszmessage.input_image.image_urlmessage.output_text.logprobszreasoning.encrypted_contentincludeinput instructionsmax_output_tokensmax_tool_callsmetadatamodel logit_biasTparallel_tool_callsprevious_response_idprompt reasoningautor{defaultflexscalepriority service_tierstorestream temperaturetext tool_choicer9toolsr top_logprobstop_ptop_kdisabledr{r truncationuserskip_special_tokensinclude_stop_str_in_outputzA key that was used to read from or write to the prompt cache.Note: This field has not been implemented yet and vLLM will ignore it.r} descriptionprompt_cache_keyc$dtSNresp_r4rCrDrEzResponsesRequest.s 7 7 7rDzThe request_id related to this request. If the caller does not set it, a random_uuid will be generated. This id is used through out the inference process and return in response.)r:r request_idz.Additional kwargs to pass to the HF processor.mm_processor_kwargszThe priority of the request (lower means earlier handling; default: 0). Any priority other than 0 will raise an error if the served model does not use priority scheduling.ra/If specified, the prefix cache will be salted with the provided string to prevent an attacker to guess prompts in multi-user environments. The salt should be random, protected from access by 3rd parties, and long enough to be unpredictable (e.g., 43 characters base64-encoded, corresponding to 256 bit). cache_saltzDictates whether or not to return messages as part of the response object. Currently only supported fornon-background and gpt-oss only. enable_response_messagesprevious_input_messagesg?)rrrdefault_max_tokensdefault_sampling_paramsreturnc|j|}nt|j|}|pi}|jx}!|d|jd}|jx}!|d|jd}|jx}!|d|jd}|d}d}|jZ|jjN|jj} | j dkr| j t| j }n| j dkrtdtj|||||r|jnd||jr t$jn t$j||jd |j|j S) Nrrrstop_token_ids json_schema)json json_objectzjson_object is not supportedT) rrr max_tokenslogprobsr output_kindstructured_outputsrv skip_clonerr)rrminrget_DEFAULT_SAMPLING_PARAMSrrrformatrfschema_r3NotImplementedErrorr2 from_optionalis_include_output_logprobsrrr1DELTA FINAL_ONLYrvrr) selfrrrrrrrrresponse_formats rEto_sampling_paramsz#ResponsesRequest.to_sampling_paramss  ! )+JJT35GHHJ"9"?R+ +K 4155t<]KKZ E (+//6w?EZ E (+//6w?E1445EFF" 9 TY%5%A"i.O$ 55#+7%<(0&&&""!%66)*HIII+#!*.*I*I*K*KUT&&QU)+/;X!'' rDbefore)modec~|ds|S|ddstd|S)NrmrTz0background can only be used when `store` is true)r ValueErrorclsdatas rEvalidate_backgroundz$ResponsesRequest.validate_background1sFxx %% Kxx&& QOPP P rDcR|dtdd|S)Nryz prompt template is not supported) parameter)rr/rs rEvalidate_promptz ResponsesRequest.validate_prompt9s7 88H   )%2h  rDc|d2t|dtr|dstd|S)Nrz>Parameter 'cache_salt' must be a non-empty string if provided.)rrUrhrrs rEcheck_cache_salt_supportz)ResponsesRequest.check_cache_salt_supportAsV 88L ! ! -4 -s33 .;? ;M .P  rDc>|d}|t|ttfr|St|ts# t |}n#t $r|cYSwxYwg}|D]}t|t ry|ddkr` |tdi|Q#t$r2t d||YwxYw||||d<|S)a{Parse function_call dictionaries into ResponseFunctionToolCall objects. This ensures Pydantic can properly resolve union types in the input field. Function calls provided as dicts are converted to ResponseFunctionToolCall objects before validation, while invalid structures are left for Pydantic to reject with appropriate error messages. rpNrf function_callzZFailed to parse function_call to ResponseFunctionToolCall, leaving for Pydantic validationrC) rrUrhbytesrB TypeErrorrVappendr r*loggerdebug)rr input_dataprocessed_inputitems rEfunction_call_parsingz&ResponsesRequest.function_call_parsingKscXXg&&   Je !E!E K*d++  !*--       - -D$%% -$((6*:*:o*M*M1#**+C+K+Kd+K+KLLLL&111LL:$**400000 1 &&t,,,,'W  s$ A A+*A+#C9C?>C?N)?r=r>r?rmboolrArorBrrhrjrqrrr@rsrtr'rurvrVfloatrwrxryrrzr(rrrrrr"rr%r)rr rrrrrrrrrrrrrrrOpenAIHarmonyMessagerr2rrr,rrrrrCrDrErlrls$Jt ###   /          -. ....#L#*###$(sTz(((!%NC$J%%% $Hho$$$E3:*.JS%Z 4'...'++++'+#*+++$(FNT !((("&Iy4&&&LRL'HIRRRE4$;FD4K $K$$$&*D t #***$K$$$d333E4:333 L#*   E54<E3:5?J*+d2???D#* $$$$',,,,#(5 '$$$cDje77 HJ27E222c3h$.E DHc#U    Jd   &+U 0&&&dIMT"6"=>ELLL  047 7 7 "&7   7 7 7 7 r D    _(###$#_(###$#_(###$#_(###''$#'''rDrlceZdZUedZeed<edZeed<dZ e dzed<dZ edzed<dZ e dzed <eed <d Zed ed <eeed <eed<eed<eed<eeed<eed<eed<eed<dZedzed<dZedzed<dZedzed<dZedzed<eded<eed<dZedzed<dZedzed<eded<dZ e!dzed <dZ"edzed!<edd"#Z#e$dzed$<edd%#Z%e$dzed&<e&d&d'(d)Z'e&d$d'(d*Z(e) d1d+e*d,e+d-ed.ed eeded e!dzd$e$dzd&e$dzd/dfd0Z,dS)2ResponsesResponsec$dtSrr4rCrDrErzResponsesResponse.ws,CKMM,C,CrDr9idcBttjSr)r@timerCrDrErzResponsesResponse.xsC 4D4DrD created_atNincomplete_detailsrqrtruresponseobjectoutputrwrrrrrmrrrsrxryrzr|rstatusrrrrusagerzBIf enable_response_messages, we can show raw token input to model.rinput_messageszCIf enable_response_messages, we can show raw token output of model.output_messagesr) when_usedc t|Srr`rr__infos rEserialize_output_messagesz+ResponsesResponse.serialize_output_messages!$'''rDc t|Srrrs rEserialize_input_messagesz*ResponsesResponse.serialize_input_messagesrrDrequestsampling_params model_name created_timerc d} |dkrtd} |did|jd|d| d|jd|jd |d |d |d | d |jd|jd|jd|jd|jd|j d|j d|j d|j d|j d|jd|jd|d|jd|jd|jd|jd|S)N incompleterr)reasonrrrrqrtrurrrrwrrrrrmrsrxryrzrrrrrrrrC)r$rrqrtrwrrrrrmrrsrxryrzrrrrr) rrrrrrrrrrrs rE from_requestzResponsesResponse.from_requests8< \ ! !!2:M!N!N!N s   !! #|  21 !--  %%  *  6 *> ,O !( ; ; (33  ++ -- "'' )) .88! "#11# $")!=!=% &>>' ('') *!--+ ,6- ./ 0)111 2))3 45 6%7  rD)NNN)-r=r>r?r)rrhrArr@rr$rqrtr'rrrBrrrr%r rsrxryrrzr(rrr"rrrMrrrirr+rr classmethodrlr2rrCrDrErrvs]e$C$CDDDBDDDe,D,DEEEJEEE37)D0777#L#*### $Hho$$$ JJJ",FGJ ,,, # $$$$ : LLL!%NC$J%%%'+#*+++$(FNT !((("&Iy4&&&HIIII &*D t #***#L#*###*++++"&E=4 &&&D#* 9> P999N.5 :? Q:::O/$6'6:::((;:( &&999((:9('+<@=A. . !. (.  .  . '( . . t#. 3T9. 4d:.  . . . [. . . rDrcbeZdZUeed< eed< eed< eed< eed< eded<dS) ResponseReasoningPartDoneEvent content_indexitem_id output_indexpartsequence_numberzresponse.reasoning_part.donerfNr=r>r?r@rArhResponseReasoningTextContentrrCrDrErrsl5 LLLGJ &&&&(, 0 1111GGrDrcbeZdZUeed< eed< eed< eed< eed< eded<dS) ResponseReasoningPartAddedEventrrrrrzresponse.reasoning_part.addedrfNrrCrDrErrsl5 LLLGJ &&&&(, 1 2222HHrDrceZdZUeed<dS)rrNr=r>r?rrArCrDrErrrDrceZdZUeed<dS)rrNrrCrDrErrrrDrceZdZUeed<dS)rrNrrCrDrErrrrDrStreamingResponsesResponse)Xrtypingrrropenai.types.responsesrrrr r r r r rrrrrrrrrrrrrrrrOpenAIResponseCompletedEventrOpenAIResponseCreatedEventrOpenAIResponseInProgressEventopenai.types.responses.toolr openai_harmonyr!rr" ImportErrorr#openai.types.responses.responser$r%.openai.types.responses.response_reasoning_itemr&ropenai.types.sharedr'r(pydanticr)r*r+r,vllm.entrypoints.chat_utilsr-'vllm.entrypoints.openai.engine.protocolr.vllm.exceptionsr/ vllm.loggerr0vllm.sampling_paramsr1r2r3 vllm.utilsr5r=rr7rGrMrZr`rbrBrirArjrlrrrrrCrDrErs  **********2VUUUUU-,,,,,::::::V9999999VVVUUUUUUUUVJIIIIIII43333333CBBBBB0/////###### #""""" X  DDDDDDDD IIIII/IIIO % % %FFF???????? #$t,F'GGI&<>P%PPPPmmmmmmmm`k k k k k k k k `HHHHH_HHH,IIIIIoIII,     9        5        ;   ##" " $ $ # #&&%%& &% %1 10 0+ +**** /!/"3#3$0%0&)')(()(*%+%,$-$Is!A(( A65A6