.`i 8ddlmZmZddlmZddlmZddlmZm Z ddl m Z m Z ddl Z ddlmZe rddlmZGd d eZeZeeeeedzeefZeeeefZed Gd dZGddeZdS))ABCabstractmethod)Sequence) dataclass)Enumauto) TYPE_CHECKINGOptionalN)SamplingParams) VllmConfigc6eZdZeZeZdS)MoveDirectionalityN)__name__ __module__ __qualname__rUNIDIRECTIONALSWAP}/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/sample/logits_processor/interface.pyrrs$TVVN 466DDDrrT)frozenc`eZdZUdZeed<eeed<eeed<ee ed<dS) BatchUpdatez2Persistent batch state change info for logitsprocs batch_sizeremovedaddedmovedN) rrr__doc__int__annotations__rRemovedRequest AddedRequest MovedRequestrrrrr$sV<<OOOn %%%% L !!!! L !!!!!!rrc eZdZedefdZedddejde ddfd Z ed ej dej fd Z ede fd Z ed edddfdZdS)LogitsProcessorsampling_paramscdS)zhValidate sampling params for this logits processor. Raise ValueError for invalid ones. Nr)clsr&s rvalidate_paramszLogitsProcessor.validate_params=s tr vllm_configr device is_pin_memoryreturnNct)NNotImplementedError)selfr*r+r,s r__init__zLogitsProcessor.__init__Es "!rlogitsct)zApply LogitsProcessor to batch logits tensor. The updated tensor must be returned but may be modified in-place. r/)r1r3s rapplyzLogitsProcessor.applyKs "!rct)aTrue if logits processor has no impact on the argmax computation in greedy sampling. NOTE: may or may not have the same value for all instances of a given LogitsProcessor subclass, depending on subclass implementation. r/)r1s ris_argmax_invariantz#LogitsProcessor.is_argmax_invariantTs "!r batch_updaterct)zCalled when there are new output tokens, prior to each forward pass. Args: batch_update: Non-None iff there have been changes to the batch makeup. r/)r1r8s r update_statezLogitsProcessor.update_state^s "!r)rrr classmethodr r)rtorchr+boolr2Tensorr5r7r r:rrrr%r%<s n["'"16"NR" """^" "EL"U\"""^""T"""^" "}- "  " " "^ " " "rr%)abcrrcollections.abcr dataclassesrenumrrtypingr r r<vllmr vllm.configr rrr!tuplelistr"r#rr%rrrrHs$#######$$$$$$!!!!!!******** '&&&&&&S.$s)d*:DIEF S#112  $"""""""".."."."."."c."."."."."r