.`ivpddlmZddlmZmZddlmZddlmZmZddl m Z ddl m Z GddZ d S) )copy)Optionalcast)CompletionOutput)RequestOutputKindSamplingParams)EngineCoreRequest)IterationStatsc@eZdZUdZeed<eed<eed<eeed<ee ed<e ed<edzed <d e d dfd Z d e d efdZ d e d eeeffdZed e fdZdede d eee effdZde fdZededdede fdZdS) ParentRequestzInfo, state & processing for parallel sampling request. Store parent request ID and sampling params. Facilitate generating child request sampling params. request_idexternal_req_idsampling_paramschild_requestsoutput_aggregatormax_num_generation_tokensNcached_child_sampling_paramsrequestreturnc|jJ|j}|j|_|j|_||_t |_|jtjkrttdg|j zng|_ d|_ d|_dS)Nr)rparamsr rsetr output_kindr FINAL_ONLYrrnrrr)selfrrs t/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/engine/parallel_sampling.py__init__zParentRequest.__init__$s&222!.!,&6.!ee +/@/KKK"D ) ) *_-> > >  *+&,0)))indexc|jj}|jr|jSt|j}d|_|||_n ||z|_|S)aREfficiently obtain child `sampling_params` If `sampling_params.seed` is not `None` then each child request requires a unique clone of parent `sampling_params` with a unique seed. Args: index: index within `n` child requests Returns: Child `sampling_params` instance. )rseedrrr)rr r#child_sampling_paramss r_get_child_sampling_paramsz(ParentRequest._get_child_sampling_params4sb #(  , 54 4 $T%9 : :"# <0ED - -*. ! &$$rc||d|j}|j||||fS)zGet child request ID and sampling params. Args: index: index within `n` child requests. Returns: (request ID, sampling_params) tuple _)r raddr%)rr child_req_ids rget_child_infozParentRequest.get_child_infoSsI 33$/33   ---T<   : A ABW X X X  ) 0 0 9 9 9 9 9  r)__name__ __module__ __qualname____doc__str__annotations__rrlistrintr rr%tupler*propertyrboolr4r8 staticmethodrr r@rrr r s OOO####H,---- #"""#14"77771 11d1111 %% %%%%> DC DE#~2E,F D D D D&3&&&X&!!,! t$%t+ , !!!!8.3.... :_-:': #:::\:::rr N)rtypingrr vllm.outputsrvllm.sampling_paramsrrvllm.v1.enginer vllm.v1.metrics.statsr r rMrrrSs!!!!!!!!))))))BBBBBBBB,,,,,,000000I:I:I:I:I:I:I:I:I:I:r