.`i d dl mZ d dlmZ d dlmZmZ d dlmZ d dl m
Z
d dl m Z er
d dl
mZ d dlmZ neZeZ G d d
e
Zd S ) )abstractmethod)Sequence)
TYPE_CHECKINGAny) DeltaMessage)ReasoningParser)
TokenizerLike)ChatCompletionRequest)ResponsesRequestc t e Zd ZdZeedefd Zeedefd Zde f fd Z
de e de
fdZde e d e e de
fd
Zdee dee fd Zd ed
edede e de e de e dedz fdZdedeez deedz edz f fdZ xZS )BaseThinkingReasoningParseraU
Base class for reasoning parsers that use thinking tokens.
This class provides common functionality for parsers that use start and end
tokens to delimit reasoning content (
e.g., ..., ...).
Subclasses must implement the start and end tokens via abstract
properties.
returnc t )z(The token that starts reasoning content.NotImplementedErrorselfs p/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/basic_parsers.py start_tokenz'BaseThinkingReasoningParser.start_token$
"! c t )z&The token that ends reasoning content.r r s r end_tokenz%BaseThinkingReasoningParser.end_token* r r tokenizerc t j |g|R i | | j st d | j r| j st d | j | j | _ | j | j | _ | j | j t | j j d d S )NzZThe model tokenizer must be passed to the ReasoningParser constructor during construction.z7start_token and end_token must be defined in subclasseszK reasoning parser could not locate think start/end tokens in the tokenizer!)
super__init__model_tokenizer
ValueErrorr r vocabgetstart_token_id end_token_id RuntimeError __class____name__)r r argskwargsr% s r r z$BaseThinkingReasoningParser.__init__0 s 4T444V444# 3
Xt~ X VWW W "jnnT-= > > JNN4> : : &$*;*C >* ; ; ;
+D*Cr input_idsc | j }| j }t t | dz
dd D ] }|| |k r dS || |k r dS !dS )N FT)r" r# rangelen)r r) r" r# is r is_reasoning_endz,BaseThinkingReasoningParser.is_reasoning_endD sn ,( s9~~)2r22 A|~-- uu||++tt ,ur delta_idsc | j }||v S )N)r# )r r) r1 r# s r is_reasoning_end_streamingz6BaseThinkingReasoningParser.is_reasoning_end_streamingO s ( y((r c r | j |dd vrg S || | j dz d S )z:
Extract the content after the end tokens
Nr, r+ )r# index)r r) s r extract_content_idsz/BaseThinkingReasoningParser.extract_content_idsU sD IcrcN 2 2I Y__T-> ? ?! C E EF Fr
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsNc t | dk r|d | j | j fv rdS | j |v r| j |v rX| | j }|d| }||t | j z d } t || r| nd S | j |v rt | S t | S | j |v r| j |v r| | j }
| | j }||
t | j z | }||t | j z d } t || r| nd S t | S t | S )z
Extract reasoning content from a delta message.
Handles streaming output where previous + delta = current.
Uses token IDs for faster processing.
r+ r N) reasoningcontent)r? )r> )r. r" r# findr r r ) r r7 r8 r9 r: r; r< end_indexr> r? start_indexs r extract_reasoning_streamingz7BaseThinkingReasoningParser.extract_reasoning_streaming^ s 1 $ $ A 4#68I"J J J4 "4 4 4 O33 'OODN ; ; &z z 2 $YT^1D1D%D%F%FG# 'G1M "&888 $J7777 $j9999
O
3
3 O33 )ood.> ? ? &OODN ; ; &{S9I5J5J'JY'V W $YT^1D1D%D%F%FG# 'G1M $j9999
333 3r model_outputrequestc | | j }|d r|d n|d }| j |vr|dfS | | j \ }}}|pd}||fS )z
Extract reasoning content from the model output.
This is the base implementation that works for most models.
Subclasses can override this method for specific behavior.
r+ r N) partitionr r )r rD rE model_output_partsr> _r?
final_contents r extract_reasoningz-BaseThinkingReasoningParser.extract_reasoning s * 3 3D4D E E%7%: U q ! !@RST@U > - - % %$0$:$:4>$J$J !Iq' #OtM m+ +r )r&
__module__ __qualname____doc__propertyr strr r r r r intboolr0 r3 listr6 r rC r
r tuplerL
__classcell__)r% s @r r
r
s "S " " " ^ X" "3 " " " ^ X"- ( (3- D )!# )3;C=)
) ) ) ) GT#Y G49 G G G G9494 94 94
%SM 94 $C=
94 "# 94
94 94 94 94v, ,*?BR*R, sTz3:% &, , , , , , , ,r r
N)abcr collections.abcr typingr r 'vllm.entrypoints.openai.engine.protocolr $vllm.reasoning.abs_reasoning_parsersr vllm.tokenizersr 0vllm.entrypoints.openai.chat_completion.protocolr
*vllm.entrypoints.openai.responses.protocolr r
r r r` s $ $ $ $ $ $ % % % % % % % % @ @ @ @ @ @ @ @ @ @ @ @ ) ) ) ) ) ) Y, Y, Y, Y, Y,/ Y, Y, Y, Y, Y,r