.`ie d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z d dl m
Z
d dlmZ e e Z G d d
e
Z G d d e Zd
S ) )Sequence)ChatCompletionRequest) DeltaMessage)ResponsesRequest) init_logger)ReasoningParser)BaseThinkingReasoningParser)
TokenizerLikec e Zd ZdZedefd Zedefd Zdedededee d ee d
ee de
d z fd Z d S )
MiniMaxM2ReasoningParserz
Reasoning parser for MiniMax M2 model.
MiniMax M2 models don't generate start token, only end
token. All content before is reasoning, content after is the
actual response.
returnc dS )z(The token that starts reasoning content. selfs ~/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/minimax_m2_reasoning_parser.py start_tokenz$MiniMaxM2ReasoningParser.start_token s y c dS )z&The token that ends reasoning content.r r s r end_tokenz"MiniMaxM2ReasoningParser.end_token% s zr
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsNc j t | dk r|d | j k rdS | j |v rt | S | j |v r\| | j }|d| }||t | j z d } t |r|nd| r| nd S t | S )z
Extract reasoning content from a delta message for streaming.
MiniMax M2 models don't generate start token, so we assume
all content is reasoning until we encounter the end token.
r Ncontent) reasoningr" )r# )len end_token_idr findr )
r r r r r r r end_indexr# r" s
r extract_reasoning_streamingz4MiniMaxM2ReasoningParser.extract_reasoning_streaming* s 1 $ $ );t?P)P)P4 2 2 2
333 3 / /"77I":I:.I S -@-@!@!B!BCG '0:))d#*4
j1111r ) __name__
__module__ __qualname____doc__propertystrr r r intr r( r r r r r s S X 3 X%2%2 %2 %2
%SM %2 $C=
%2 "# %2
%2 %2 %2 %2 %2 %2r r c e Zd ZdZdef fd Zdee defdZ de
e de
e fdZ de d e d
e d ee d ee d
ee de
dz fdZde deez dee dz e dz f fdZ xZS )#MiniMaxM2AppendThinkReasoningParserz0
Reasoning parser for MiniMax M2 model.
tokenizerc t j |g|R i | | j d | _ d S )Nr )super__init__vocabgetr% )r r2 argskwargs __class__s r r5 z,MiniMaxM2AppendThinkReasoningParser.__init__W sF 4T444V444 JNN: 6 6r input_idsr
c b | j t fdt | D S )Nc 3 $ K | ]
}|k V d S Nr ).0input_idr% s r zGMiniMaxM2AppendThinkReasoningParser.is_reasoning_end..] s( PP8|+PPPPPPr )r% anyreversed)r r; r% s @r is_reasoning_endz4MiniMaxM2AppendThinkReasoningParser.is_reasoning_end[ s6 ( PPPPHY r )r r; s r extract_content_idsz7MiniMaxM2AppendThinkReasoningParser.extract_content_ids_ s r r r r r r r Nc R t | dk rd|z }t | S )Nr r r! )r$ r )r r r r r r r s r r( z?MiniMaxM2AppendThinkReasoningParser.extract_reasoning_streamingb s3 ! " "a ' '"Z/JJ////r model_outputrequestc d d|z fS )Nr r )r rH rI s r extract_reasoningz5MiniMaxM2AppendThinkReasoningParser.extract_reasoningo s Y ---r )r) r* r+ r, r
r5 r r/ boolrD listrF r. r r( r r tuplerK
__classcell__)r: s @r r1 r1 R sQ 7- 7 7 7 7 7 7Q(3- QD Q Q Q QT#Y 49 0 0 0 0
%SM 0 $C=
0 "# 0
0 0 0 0. .*?BR*R. sTz3:% &. . . . . . . .r r1 N)collections.abcr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr *vllm.entrypoints.openai.responses.protocolr vllm.loggerr $vllm.reasoning.abs_reasoning_parsersr vllm.reasoning.basic_parsersr vllm.tokenizersr
r) loggerr r1 r r r rY s, % $ $ $ $ $ $ # # # # # @ @ @ @ @ @ D D D D D D ) ) ) ) ) ) X 82 82 82 82 82 : 82 82 82v . . . . ./ . . . . .r