.`io d dl Z d dlmZ d dlmZ d dlZd dlmZ d dl m
Z
d dl m Z m
Z
mZmZmZmZ d dlmZ d dlmZ d d lmZ d d
lmZ ee Z G d d e Z dS )
N)Sequence)Any)make_tool_call_id)ChatCompletionRequest)DeltaFunctionCall DeltaMessage
DeltaToolCall ExtractedToolCallInformation FunctionCallToolCall) init_logger)
TokenizerLike)
ToolParser)extract_intermediate_diffc e Zd Zdef fd ZdedefdZdedefdZdedefd Zded
e de
fd Z d edd
fdZ d ede
fdZdede
fdZdedeeef fdZdedefdZd0dZd0dZdedd
fdZdefdZdedefdZdedd
fdZd edefd Zd edeeeef fd Z d ed e j e defd Z d ed!edeed
z ed
z f fd"Z d edede!d
z fd#Z"d edede!d
z fd$Z#d%ede
fd&Z$d'ed%eded(e%e d)e%e d*e%e d
e de!d
z fd+Z&d%eded
z fd,Z'd%eded-eded
z fd.Z(d%ed-edefd/Z) xZ*S )1MinimaxToolParser tokenizerc b t | dg g d| _ d| _ d| _ t j dt
j | _ d| _ t j d | _
t j d | _ d | _ d
| _
| j st d | j | j | _ | j | j | _ | j | j t( d d S d S )
Ncurrent_tool_indextool_ids
sent_toolsz z
z/(.*?)|(.*)(.*?)z"name":\s*"([^"]+)"z"arguments":\s* FzUThe model tokenizer must be passed to the ToolParser constructor during construction.zrMinimax Tool parser could not locate tool call start/end tokens in the tokenizer. Falling back to string matching.)super__init__streaming_statetool_call_start_tokentool_call_end_tokenrecompileDOTALLtool_call_regexthinking_tag_patterntool_name_patterntool_args_patternpending_bufferin_thinking_tagmodel_tokenizer
ValueErrorvocabgettool_call_start_token_idtool_call_end_token_idloggerwarning)selfr __class__s y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/tool_parsers/minimax_tool_parser.pyr zMinimaxToolParser.__init__! s:
### #% 0
0
&4"#2 !z >
%<!!#,B!C!C !#,>!?!? ! $ # 3
)-
t7Q(R(R%&*jnnT5M&N&N# ( 0D4O4W NNL
5X4W model_outputreturnc V d }t j | j ||t j S )z
Preprocess model output by removing tool calls from thinking tags.
Args:
model_output: Raw model output string
Returns:
Preprocessed model output with tool calls removed from thinking tags
c | | d }t j dd|t j }d| dS )N z .*?r flags)groupr! subr# )match
think_contentcleaned_contents r4 remove_tool_calls_from_thinkzOMinimaxToolParser.preprocess_model_output..remove_tool_calls_from_thinkT sE !KKNNM f/]") O 7_666 6r5 r; )r! r@ r% r# )r2 r6 rD s r4 preprocess_model_outputz)MinimaxToolParser.preprocess_model_outputI s= 7 7 7 v % ( )
r5 args_textc R | }|s|S t j | |S # t j $ r Y nw xY w| d rM|dd } t j | |S # t j $ r |}Y nw xY w| d M|S )z
Clean duplicate closing braces from arguments text.
Args:
args_text: Raw arguments text
Returns:
Cleaned arguments text with proper JSON formatting
z}}Nr )stripjsonloadsJSONDecodeErrorendswith)r2 rF candidates r4 _clean_duplicate_bracesz)MinimaxToolParser._clean_duplicate_bracesb s OO%% Jy ! ! ! # D && &!#2#I
&
9%%% '
&
&
& %
& && & s! 0 AA%A; ;BB
delta_textc |s|S | }|rMt d |D r4| d }|dk r| d rdndS |S )z
Clean delta text by removing excessive closing braces.
Args:
delta_text: Delta text to clean
Returns:
Cleaned delta text
c 3 K | ]}|d v V dS )z}
N ).0cs r4 z8MinimaxToolParser._clean_delta_braces.. s& !J!Ja!z/!J!J!J!J!J!Jr5 }r:
z}
)rH allcountrL )r2 rO delta_stripped brace_counts r4 _clean_delta_bracesz%MinimaxToolParser._clean_delta_braces s #))++ Cc!J!J>!J!J!J J J C(..s33KQ * 3 3D 9 9BuusBr5 requestc
| | }| j |vrt dg | S | j | }g }|D ]}|d r|d n|d }| r| d }|D ]} | } | rj| d rU| d r@ t j
| }
| |
m# t j $ r Y ~w xY wg } |D ]]} d| v rWd | v rS| t d
t | d t j | d d
^| | j }
|
dk r|d|
}|rw| d }t# | D ]O} | } | r7| | }|dk r |d|t% | z } nPd}nd}n|}t t% | dk | | r| nd S # t& $ r/ t( d t dg | cY S w xY w)a
Extract tool calls from model output for non-streaming mode.
Args:
model_output: Complete model output
request: Chat completion request
Returns:
ExtractedToolCallInformation containing tool calls and content
F) tools_called
tool_callscontentr r: rW {rV name argumentsfunction) ensure_ascii)rc rd )typere r Nr z9An unexpected error occurred during tool call extraction.)rE r r
r$ findallrH split
startswithrL rI rJ appendrK r r dumpsfindreversedlen Exceptionr0 exception)r2 r6 r] processed_outputfunction_call_tuplesraw_function_callsrA tool_call_contentlinesline parsed_callr`
function_call
processed_posprocessed_contentposra s r4 extract_tool_callsz$MinimaxToolParser.extract_tool_calls sh 77 EE %-= = =/ "r<
@ #'#7#?#?@P#Q#Q !# -
)
)05a$FE!HHeAh!$**,, ) - 3 3 5 5 ; ;D A AE % ) ) #zz|| )DOOC$8$8 )T]]3=O=O ) ).2j.>.> 2 9 9+ F F F F#'#7 ) ) ) ( ) J!3
]**{m/K/K %% !+%1%26%:*.*$1+$>U+" +" +"& & &
- 1 1$2L M MM ""$4^m^$D$J$J$L$L!$ ! - 3 3D 9 9E ( % % #zz|| &"."3"3D"9"9C "byy*67Hs4yy 7H*I %"$ GG&/ __q 0%+2==??D
K
0 "r<
s7 B7J *)DJ D&#J %D&&E+J 6K
K textNc | d }| d }||k p||k o| d | _ dS )z
Update the thinking tag state based on text content.
Args:
text: Text to analyze for thinking tags
r= r> N)rY rL r) )r2 r~
open_count close_counts r4 _update_thinking_statez(MinimaxToolParser._update_thinking_state sZ ZZ **
jj,, )K 7
+ % C$--
*C*C
r5 c
| j | j fD ]Zt fdt dt t dz t D r dS [dS )z
Check if text might be the start of a tool call tag.
Args:
text: Text to check
Returns:
True if text could be the start of a tool call tag
c 3 T K | ]"} | d V #d S N)rj )rS itagr~ s r4 rU z. sM tQBCCy)) r5 r: TF)r r anyrangeminro )r2 r~ r s `@r4 _is_potential_tag_startz)MinimaxToolParser._is_potential_tag_start s .0HI C q#c$ii!mSXX">">??
tt
ur5 c | j rdS t | j p&| j |v p | j |v p| d S )z
Determine if content should be buffered for later processing.
Args:
delta_text: Delta text to check
Returns:
True if content should be buffered
F<)r) boolr( r r rj )r2 rO s r4 _should_buffer_contentz(MinimaxToolParser._should_buffer_content
sd 5
*)Z7
*':5
* $$S))
r5 c 6 | j r|dfS | j | j fD ]|}t dt | D ]\}|d| }| | }|dk r5| ||d r|d| ||d fc c S ]}|dfS )z
Split delta text into safe content and potential tag content.
Args:
delta_text: Delta text to split
Returns:
Tuple of (safe_content, potential_tag_content)
r r: Nr )r) r r r ro rfindrj )r2 rO r r
tag_prefixr| s r4 _split_content_for_bufferingz.MinimaxToolParser._split_content_for_buffering s " r> !.0HI > >C1c#hh''
>
> !W
&&z22"99
3440@!A!A9%dsd+Z-=======
>
2~ r5 new_contentc ( | xj |z
c_ d}| j r| j }d| _ |S | j r| j | j }| j | j }|dk r#|dk s||k r|t | j }}nJ|dk r|t | j }}n-| | j rnB|| j z
}d| _ n0|| j d| z
}| j ||z d | _ | j |S )z
Process buffered content and return output content.
Args:
new_content: New content to add to buffer
Returns:
Processed output content
r r N)r( r) rm r r ro r )r2 r output_content start_posend_postag_postag_lens r4 _process_bufferz!MinimaxToolParser._process_buffer5 sG
{* " ! 0N"$D ! !! K +001KLLI)..t/GHHGBGrMMY5H5H#,c$2L.M.MB #*C0H,I,I//0CDD $"55&(# d 1(7( ; ;N"&"5g6G6I6I"JD ! ! K$ r5 c dg g d| _ dS )z,Reset the streaming state to initial values.r r Nr r2 s r4 _reset_streaming_statez(MinimaxToolParser._reset_streaming_state[ s" #%
r5 c P t | j d dz | j d< dS )z3Advance to the next tool in the streaming sequence.r r: Nintr r s r4 _advance_to_next_toolz'MinimaxToolParser._advance_to_next_toolc s1
$%9: ; ;a ?
1222r5 indexc || j d< dS )za
Set the current tool index.
Args:
index: Tool index to set
r Nr )r2 r s r4 _set_current_tool_indexz)MinimaxToolParser._set_current_tool_indexi s 6; 1222r5 c 6 t | j d S )z^
Get the current tool index.
Returns:
Current tool index
r r r s r4 _get_current_tool_indexz)MinimaxToolParser._get_current_tool_indexr s 4'(<=>>>r5
tool_countc t | j d }t | D ]+}|t | k r|| d s|c S (|c S dS )z
Get the index of the next unsent tool.
Args:
tool_count: Total number of tools
Returns:
Index of next unsent tool, or -1 if all tools sent
r sent_namer )listr r ro )r2 r r r s r4 _get_next_unsent_tool_indexz-MinimaxToolParser._get_next_unsent_tool_index{ sp $.|<==
z"" A3z??""!!}[1 HHH rr5 c t | j d }t | j d }t | |k r8| ddt d t | |k 8t | |k r(| d t | |k (|| j d< || j d< dS )z
Ensure state arrays have sufficient capacity for tool_count tools.
Args:
tool_count: Number of tools to prepare for
r r Fr )r sent_argumentsidN)r r ro rk r )r2 r r r s r4 _ensure_state_arraysz&MinimaxToolParser._ensure_state_arrays s $.|<==
,Z899*oo
** !&&(+--
*oo
** (mmj(( OOD ! ! ! (mmj(( .8 \*+3 Z(((r5 c T | j | }t | S )z
Detect the number of tools in text by counting name patterns.
Args:
text: Text to analyze
Returns:
Number of tools detected
)r& rh ro )r2 r~ matchess r4 _detect_tools_in_textz'MinimaxToolParser._detect_tools_in_text s& (00667||r5 c g }d}|t | k r|| dk r|}d}d}d}|t | k r|| dk r|dz
}nF|| dk r:|dz }|dk r/|dz }||| } d| v rd| v r| ||f n>|sd|||dz v rd}|sd|||dz v rd}|dz
}|t | k |dk r|r| ||f n|dz
}|t | k |S ) z
Find the boundaries of tool calls in text.
Args:
text: Text to analyze
Returns:
List of (start, end) positions for tool calls
r rb Fr: rV z"name"z "arguments"T)ro rk )
r2 r~
boundariesr startdepthhas_name
has_argumentsendsegments
r4 _find_tool_boundariesz'MinimaxToolParser._find_tool_boundaries sv
#d))mmAw#~~ %
#d))mmAw#~~
aC
A::"#a%C&*59oG '7 2 2}7O7O * 1 15#, ? ? ? !# (DQ 4G(G(G#'( -]d51q5=>Q-Q-Q(,
FA# #d))mm& 1999 %%uaj111Q; #d))mm< r5 tool_content
args_matchc | }||d }| d rDd}t | D ]1\ }}|dk r|dz
}|dk r|dz }|dk r|d|dz c S 2n7| d }|dk r |d| S | d S )z
Extract tool arguments from tool content.
Args:
tool_content: Tool call content
args_match: Regex match for arguments pattern
Returns:
Extracted arguments as string
Nrb r r: rV )r rH rj enumeraterm rstrip) r2 r r args_start_posremaining_contentr r charargs_ends r4 _extract_tool_argsz$MinimaxToolParser._extract_tool_args s $ )) ( 9 " " $ $ / / 4 4 <E$%677
:
:43;;QJEES[[QJE zz 01q5 9999
: )--c22H!||((399;;; '',,22444r5
tool_indexc
| | }|t | k rdS || \ }}||| }| j | }|r| d nd}| j | } | rr | || }
||
fS # t $ rJ || d } | d
}
||
fcY S w xY w|dfS )a
Get the content of a specific tool by index.
Args:
text: Text containing tool calls
tool_index: Index of tool to extract
Returns:
Tuple of (tool_name, tool_arguments) or (None, None) if not found
)NNr: NrV ) r ro r& searchr? r' r rp r r rH ) r2 r~ r r r r r
name_matchrc r rF r s r4 _get_current_tool_contentz+MinimaxToolParser._get_current_tool_content s. //55
Z ( ( :
+
sE#I +22<@@
&0:z """d+22<@@
'
' 3 3L* M M Y&
'
'
'$0 1A1A1C1C$D! - 4 4S 9 9 ? ? A A Y&&&
'
Tzs B* *AC>=C>c
H | | }|dk rdS | | }|t | k rdS | || \ }}|sdS | | t | j d }t | j d }|| d } | ||< d|| d< || j d< || j d< t t |d| t |
d
g S )
z
Handle streaming of tool names.
Args:
tool_content: Content containing tool calls
tool_count: Total number of tools
Returns:
DeltaMessage with tool name or None if no tool to stream
r Nr r r Tr re )rc exclude_none)r rg r re r` ) r r ro r r r r r r r
model_dump)
r2 r r next_idxr tool_name_r r tool_ids
r4 _handle_tool_name_streamingz-MinimaxToolParser._handle_tool_name_streaming" sR 33J?? r>>4// ==
s: & &455lHMM 1 4 $$X...$.|<==
,Z899 X&t, $,0
8 [)-7 \*+3 Z( "# .I > > > I I%) J
r5 c | }|dk s||k rdS | || \ }}|r|dS t | j d }|| d sdS | | }|| d }||k rX|r| | rt
|| } | r| | } ||| d< || j d< | d r| t t |t |
d
g S n|s|r| | }
||| d< || j d< | d r| t t |t |
d
g S dS ) a
Handle streaming of tool arguments.
Args:
tool_content: Content containing tool calls
tool_count: Total number of tools
Returns:
DeltaMessage with tool arguments or None if no arguments to stream
r Nr r r rV )rd Tr )r re r )r r r r rN rj r r\ rL r r r r r ) r2 r r current_idxr tool_argsr
clean_args sent_args
args_deltaclean_args_deltas r4 _handle_tool_args_streamingz-MinimaxToolParser._handle_tool_args_streamingT s_ 2244 ??kZ 7 74 # = =lK X X 9 I -4$.|<==
+&{3 411)<<
{+,<= " " %
Z 2 29 = = %
6z9 M M
!%!9!9*!E!EJ@JJ{+,<=9CD( 6!**3// 5 22444' )&1):.8*" *" *"",*$*"?"? $ $
:
#'#;#;J#G#G |D ]"t fd|D }|s dS #dS )NFr Tr r: r; c 3 6 K | ]\ }}|k o|k V d S r rR rS t_startt_endr| s r4 rU z7MinimaxToolParser._is_end_tool_calls.. E 3A7Ew.3; r5 )
r rm rk r! finditerr% r# r r r )r2 r end_token_positions search_start
think_regionsrA in_thinkr| s @r4 _is_end_tool_callsz$MinimaxToolParser._is_end_tool_calls s. #< 7 75 # ##D$ > > >& C ER H
tt
ur5
previous_textprevious_token_idscurrent_token_idsdelta_token_idsc 8 | | | j rt | S | | r)| | }|rt | nd S | | rt | S | | \ } }
|
r$| xj |
z
c_ | rt | nd S | | } | j | vr|| j
|v r | j |v rd S | dk r | j |v rd S | dk r | j
|v r|
t | S | j | j |v rt | dk rd S | | } | d S | ||| }
|
rt |
S | || }| | }|dk rd S | dk r|
| | | || p| || S # t. $ r t0 dd Y d S w xY w)N)ra r r r: r z An unexpected error occurred z$during streaming tool call handling.)r r) r r r r r r( rE r r rH r r r. ro !_find_tool_start_outside_thinking _extract_content_before_tools_extract_tool_contentr r r r rp r0 rq )r2 r r rO r r r r] buffered_output safe_content
potential_tagprocessed_current_textoriginal_tool_startcontent_before_toolsr current_tools_counts r4 extract_tool_calls_streamingz.MinimaxToolParser.extract_tool_calls_streaming s*
##L111 4
333 3 & &z 2 2 V " 2 2: > >O>t !!R''D,F,,V,Vt,,.."44, <<++---
333 3
) 5- @@O$$))4 " D D\ R R &4 # A A *&9
> (<=== = 55lDWXXL"&"<"<\"J"J "a''t++--33++--- % %&9 : : :33 1 U11,@STT
U /1W
44 s 1I0 A,I0 0%JJc d} | | j | dk rdS d t j d|t j D }t fd|D }|sS d z }s)
z
Find the start position of tool calls outside of thinking tags.
Args:
current_text: Current text to search
Returns:
Position of tool call start or None if not found
r Tr Nc ^ g | ]*}| | f+S rR )r r )rS ms r4
zGMinimaxToolParser._find_tool_start_outside_thinking.. s= AEEGG$ r5 r r; c 3 6 K | ]\ }}|k o|k V d S r rR r s r4 rU zFMinimaxToolParser._find_tool_start_outside_thinking..! r r5 r: )rm r r! r r# r )r2 r r r r r| s @r4 r z3MinimaxToolParser._find_tool_start_outside_thinking s # ##D$> MMCbyyt +\ M ER H
7L% #r5
tool_startc |dk rPt | t | z
}||k r+|}|t | z |k r
|d||z
}|r|ndS dS )a
Extract content that appears before tool calls.
Args:
current_text: Current text
delta_text: Delta text
tool_start: Start position of tools
Returns:
Content before tools or None
r N)ro )r2 r rO r delta_start_pos content_parts r4 r z/MinimaxToolParser._extract_content_before_tools* st >> !, / /#j// AO ++ ) "S__4zAA#-.L
_0L.L#ML'3=||=tr5 c |t | j z }||d }| | j }|dk r
|d| }|S )z
Extract tool content from current text starting at tool_start.
Args:
current_text: Current text
tool_start: Start position of tool calls
Returns:
Extracted tool content
Nr )ro r rm r )r2 r r tool_content_startr r s r4 r z'MinimaxToolParser._extract_tool_contentA s^ (#d.H*I*I I#$6$7$78 ##D$<== b=='1Lr5 )r7 N)+__name__
__module__ __qualname__r r strrE rN r\ r r
r} r r r r tupler r r r r r r r r r r r r! Matchr r r r r r r r r r r
__classcell__)r3 s @r4 r r s &- & & & & & &P
C
C
2 <c c ,VV 'V
& V V V Vp
3
4
C D $
& s uS#X *$ 3 $ 3 $ $ $ $ L
;S ;T ; ; ; ;? ? ? ? ?c c &4s 4t 4 4 4 42 # # *# *$uS#X2G * * * *X 5s 5
5RU 5 5 5 5<""%(" sTz3:% &" " " "H0
0
-00
0
0
0
0
dF F-0F F F F FPs t 8QQ Q Q
%SM Q $C=
Q "# Q 'Q
Q Q Q Qf #c #cDj # # # #> -0>A t . # 3 3 r5 r ) rI collections.abcr typingr regexr! vllm.entrypoints.chat_utilsr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr r r r
r r vllm.loggerr
vllm.tokenizersr &vllm.tool_parsers.abstract_tool_parserr vllm.tool_parsers.utilsr r r0 r rR r5 r4 r se $ $ $ $ $ $ 9 9 9 9 9 9 $ # # # # # ) ) ) ) ) ) > = = = = = X s s s s s
s s s s s r5