.`i d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z e e Z
G d de Zd S )
)Sequence)PreTrainedTokenizerBase)ChatCompletionRequest) DeltaMessage) init_logger)BaseThinkingReasoningParserc e Zd ZU dZdZeed< dZeed< dZeed< e defd Z
e defd
Z d e f fd Z
d
edededee dee dee dedz fdZdededeedz edz f f fd Z xZS )Ernie45ReasoningParserz
Reasoning parser for Ernie45 thinking model.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
z
response_start_tokenz response_end_tokenz<0x0A>
newline_tokenreturnc dS )z(The token that starts reasoning content.z selfs {/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/ernie45_reasoning_parser.py start_tokenz"Ernie45ReasoningParser.start_token s y c dS )z&The token that ends reasoning content.zr r s r end_tokenz Ernie45ReasoningParser.end_token# s zr tokenizerc 6 t j |g|R i | | j st d | j | j | _ | j | j | _ | j | j
| _ | j | j | _
| j | j | _ | j | j
g| _ | j | j t# d d S )NzZThe model tokenizer must be passed to the ReasoningParser constructor during construction.zRErnie45 reasoning parser could not locate think start/end tokens in the tokenizer!)super__init__model_tokenizer
ValueErrorvocabgetr start_token_idr end_token_idr response_start_token_idr response_end_token_idr
newline_token_idparser_token_ids RuntimeError)r r argskwargs __class__s r r z Ernie45ReasoningParser.__init__( s 4T444V444# 3
#jnnT-= > > JNN4> : :'+z~~d6O'P'P$%)Z^^D4K%L%L" $
t/A B B !%!2D4N O &$*;*C +
+D*Cr
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsNc 6 t | dk r$|d | j | j | j | j fv rdS | j |v r| | j }|d| }||t | j z d } | d } | | j }
| | j
} |
dk r | |
t | j z d } | dk r
| d| } t || r| nd S | j |v rj|} | j |v ry| d } | | j }
| |
t | j z d } | | j
} | dk r
| d| } n-| j |v r$| | j
} | d| } |d | j v r9t | dk r&|d | j
k r| d } t | dk rJ|d | j k r9t | dk r&|d | j
k r| d } t | r| nd S t | S )
az
Extract reasoning content from a delta message.
Handles streaming output where previous + delta = current.
Uses token IDs for faster processing.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
- 'abc' goes to reasoning
- 'def' goes to content
r N
) reasoningcontent)r5 )r4 )lenr r! r" r# findr lstripr rfindr r r% r$ ) r r* r+ r, r- r. r/ think_end_indexr4 r5 response_start_idxresponse_end_idxs r extract_reasoning_streamingz2Ernie45ReasoningParser.extract_reasoning_streaming? s ( 1 $ $ A #!,*
4 / / )oodn = =O"#3O#34I 3t~3F3F!F!H!HIG nnT**G!( d.G!H!H &}}T-D E E !R''!"4s4;T7U7U"U"W"WX 2%%!"3#3"34 ##*4
"4
4
4 G+>>!....%,\\$2K%L%L"!"4s4;T7U7U"U"W"WX#*==1H#I#I #r)) %&7'7&7 8G+>>#*==1H#I#I !"3#3"34!"%)>>>O$$q((_Q-?4CX-X-X!.... &''!++&r*d.???O$$q((_Q-?4CX-X-X!.... 7(DEEE E *555 5r model_outputrequestc , t || \ }}|re| | j }| | j }|dk r+|dk r%||k r ||t
| j z | }|pd}||fS )ak
Extract reasoning content from the model output.
The Ernie45 thinking model ouput format is
abc
def
or abc
def
- 'abc' goes to reasoning
- 'def' goes to content
Returns:
tuple[Optional[str], Optional[str]]: reasoning content and content
r3 N)r extract_reasoningr8 r r: r r7 ) r r? r@ r4 r5 start_idxend_idx
final_contentr) s r rB z(Ernie45ReasoningParser.extract_reasoning s #WW 6 6|W M M 7 X T%>??I mmD$;< r tuplerB
__classcell__)r) s @r r
r
s !-#,,, ++++!M3!!!
S X 3 X"9 .Q6Q6 Q6 Q6
%SM Q6 $C=
Q6 "# Q6
Q6 Q6 Q6 Q6f( (*?( sTz3:% &( ( ( ( ( ( ( ( ( (r r
N)collections.abcr transformersr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr vllm.loggerr vllm.reasoning.basic_parsersr rF loggerr
r r r rW s % $ $ $ $ $ 0 0 0 0 0 0 A @ @ @ @ @ # # # # # # D D D D D D X V( V( V( V( V( 8 V( V( V( V( V(r