.`i"ddlmZddlmZddlmZddlmZmZm Z m Z erddlm Z GddZ Gdd Z d S) )Iterator)chain) TYPE_CHECKING) AddedRequest BatchUpdate MovedRequestRemovedRequest)LogitsProcessorc HeZdZUdZeeed<eed<eeed<ee ed< ddeedzdeedzdee dzddfd Z dd Z e deefd Z d eddfd ZdefdZdedzfdZdedzfdZdefdZdededzfdZdS)BatchUpdateBuilderaHelps track persistent batch state changes and build a batch update data structure for logitsprocs Assumptions: * All information about requests removed from persistent batch during a step is aggregated in self._removed through calls to self.removed_append() at the beginning of a step. This must happen before the first time that self.removed, self.pop_removed() or self.peek_removed() are invoked in a given step * After the first time that self.removed, self.pop_removed() or self.peek_removed() are read in a step, no new removals are registered using self.removed_append() * Elements of self._removed are never directly modified, added or removed (i.e. modification is only via self.removed_append() and self.pop_removed()) Guarantees under above assumptions: * self.removed is always sorted in descending order * self.pop_removed() and self.peek_removed() both return the lowest removed request index in the current step _removed_is_removed_sortedaddedmovedNremovedreturncX|pg|_|pg|_|pg|_d|_d|_dS)NF)r rrr batch_changed)selfrrrs y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/sample/logits_processor/state.py__init__zBatchUpdateBuilder.__init__,s=  2 [b [b "'#c\|js$|jdd|_dSdS)zSort removed request indices in descending order. Idempotent after first call in a given step, until reset. T)reverseN)rr sortrs r_ensure_removed_sortedz)BatchUpdateBuilder._ensure_removed_sorted;s@ & + M  t  , , ,&*D # # # + +rc8||jS)z:Removed request indices sorted in descending order)rr rs rrzBatchUpdateBuilder.removedEs ##%%%}rindexct|jrtd|j|d|_dS)zRegister the removal of a request from the persistent batch. Must not be called after the first time self.removed, self.pop_removed() or self.peek_removed() are invoked. Args: index: request index zECannot register new removed request after self.removed has been read.TN)r RuntimeErrorr appendr)rrs rremoved_appendz!BatchUpdateBuilder.removed_appendLsJ  " W  U###!rc*t|jSN)boolr rs r has_removedzBatchUpdateBuilder.has_removed\sDM"""rcp|r!||jdSdS)z#Return lowest removed request indexN)r'rr rs r peek_removedzBatchUpdateBuilder.peek_removed_s:      %  ' ' ) ) )=$ $trc|r-||jSdS)z Pop lowest removed request indexN)r'rr poprs r pop_removedzBatchUpdateBuilder.pop_removedfsA      '  ' ' ) ) )=$$&& &trcd|_|j|j|j|j}d|_|S)z4Returns True if there were any changes to the batch.F)rr clearrrr)rrs rresetzBatchUpdateBuilder.resetms\"'   * "r batch_sizecd|_d|_t|j|j|jfsdSt ||j|j|j}g|_g|_g|_|S)aGenerate a logitsprocs batch update data structure and reset internal batch update builder state. Args: batch_size: current persistent batch size Returns: Frozen logitsprocs batch update instance; `None` if no updates FN)r1rrr)rranyr rrr)rr1 batch_updates r get_and_resetz BatchUpdateBuilder.get_and_resetwsy#("DM4:tz:;; 4"!M**       r)NNN)rN)__name__ __module__ __qualname____doc__listr __annotations__r&rrrrpropertyrintr#r'r*r-r0rr5rrr r s(>""""    04+/+/ # #n%, #L!D( #L!D( #  # # # #++++n-X "C"D"""" #T####cDjS4Zt d0Brr c^eZdZdZddeddzddfdZededfdZdS) LogitsProcessorsz,Encapsulates initialized logitsproc objects.N logitsprocsr rcg|_g|_|r:|D]9}|r|jn|j|8dSdSr%)argmax_invariantnon_argmax_invariantis_argmax_invariantr")rrA logitprocs rrzLogitsProcessors.__init__st79;=!  $( $ $ !44663D))2&####  $ $ $ $rc6t|j|jS)z$Iterator over all logits processors.)rrCrDrs rallzLogitsProcessors.allsT*D,EFFFrr%)r6r7r8r9rrr<rHr>rrr@r@s66 $ $H->$?$$F $RV $ $ $ $GX/0GGGXGGGrr@N)collections.abcr itertoolsrtypingr)vllm.v1.sample.logits_processor.interfacerrrr r r r@r>rrrMs%$$$$$ JIIIIIIDGGGGGGGGGGr