.`i>
U d dl Z d dlZd dlmZ d dlZdZdZee d< dZ
ee d< dZ ee d < d
Z ee d < d Z
ee d
< dZee d< dZee d< dZee d< dZdZee d< dZee d< dZdZee d< d ed efd Zd Zd Zd! Zd"eeef d efd#Zd$ed%eee eef f d eeef fd&Z d'e eeeeeef z f d efd(Z d)e eeef d e fd*Z!d+e d)e eeef d,ed efd-Z" d:d)e eeef d.e dz d e eeef fd/Z# d;d)e eeef d,ed1e eeef dz d2e$d3e$d ef d4Z%d+e d5ed6e e d e e edez f fd7Z&d+e d5efd8Z'd5ed,efd9Z(dS )< N)Anya ## Tools
You have access to a set of tools you can use to answer the user's question.
You can invoke functions by writing a "<{dsml_token}function_calls>" block like the following as part of your reply to the user:
<{dsml_token}function_calls>
<{dsml_token}invoke name="$FUNCTION_NAME">
<{dsml_token}parameter name="$PARAMETER_NAME" string="true|false">$PARAMETER_VALUE
...
<{dsml_token}invoke name="$FUNCTION_NAME2">
...
String and scalar parameters should be specified as is without any escaping or quotes, while lists and objects should use JSON format. The "string" attribute should be set to "true" for string type parameters and "false" for other types (numbers, booleans, arrays, objects).
If the thinking_mode is enabled, then after function results you should strongly consider outputting a thinking block. Here is an example:
<{dsml_token}function_calls>
...
...
{thinking_start_token}...thinking about results{thinking_end_token}
Here are the functions available in JSONSchema format:
{tool_schemas}
u <｜begin▁of▁sentence｜> bos_tokenu <｜end▁of▁sentence｜> eos_tokenzthinking_start_tokenzthinking_end_tokenu
｜DSML｜
dsml_tokenz {content}system_msg_templateu& <｜User｜>{content}<｜Assistant｜>user_msg_templateu; {reasoning}{content}{tool_calls}<｜end▁of▁sentence｜>assistant_msg_templatez{reasoning_content}zX## Response Format:
You MUST strictly adhere to the following schema to reply:
{schema}response_format_templatezD<{dsml_token}invoke name="{name}">
{arguments}
tool_call_templatezG<{dsml_token}function_calls>
{tool_calls}
z
{content}tool_output_templatevaluereturnc | t j | d S # t $ r t j | d cY S w xY w)NF) ensure_asciiT)jsondumps Exception)r s y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/tokenizers/deepseek_v32_encoding.pyto_jsonr = sR 4z%e4444 4 4 4z%d3333334s ;;c d | D S )Nc g | ]
}|d S )function ).0tools r
z,tools_from_openai_format..E s / / /D / / / r )toolss r tools_from_openai_formatr! D s / / / / //r c d | D S )Nc H g | ] }|d d |d d d S )r name argumentsr$ r% r r tool_calls r r z1tool_calls_from_openai_format..I sK
j)&1":.{;
r r
tool_callss r tool_calls_from_openai_formatr+ H s%
$ r c d | D S )Nc 6 g | ]}d |d |d ddS )r r$ r% r& )typer r r' s r r z/tool_calls_to_openai_format..S sN
!&) &{ 3
r r r) s r tool_calls_to_openai_formatr/ R s% $ r r( c
d}g }t | d t rt j | d }n| d }| D ]s\ }}| t |t |t rdndt |t r|nt | }| | td | S )NzU<{dsml_token}parameter name="{key}" string="{is_str}">{value}r% truefalse)r keyis_strr
)
isinstancestrr loadsitemsformatr r appendjoin)r( p_dsml_template P_dsml_strsr% kv
p_dsml_strs r encode_arguments_to_dsmlrB _ s qOK)K(#.. +Jy 566 k* !! ' '1$++! '3 / /<66W!!S))9!!wqzz ,
:&&&& 99[ ! !!r tool_name tool_argsc dt dt dt fddd fd| D z dz }t | | S )
Nr3 r stringc T |dk rt | }t | d| S )Nr1 z: r )r3 r rF s r
_decode_valuez/decode_dsml_to_arguments.._decode_valuew s2 V ENNE#,,))%)))r {z, c 8 g | ]\ }\ }} ||| S ))rF r )r r? r@ r4 rI s r r z,decode_dsml_to_arguments.. s2 X X XNA{6]]1a
/
/
/ X X Xr }r& )r7 r< r9 dict)rC rD tool_args_jsonrI s @r decode_dsml_to_argumentsrO t s *3 *s *C * * * *
)) X X X XiooFWFW X X X
Y. 9 9 99r r c d | D }t d | t t t
S )Nc , g | ]}t | S r rH )r ts r r z render_tools.. s ,,,'!**,,,r r5 ) tool_schemasr r r )TOOLS_SYSTEM_TEMPLATEr: r< r r r )r
tools_jsons r render_toolsrV sJ ,,e,,,J ' 'YYz** 1- ( r messagesc d}t t | dz
dd D ]#}| | d dv r|} n$|S )N role)user developer)rangelenget)rW last_user_indexidxs r find_last_user_indexrc sb OS]]Q&B// C= V $ $(= = = !O E > r index
thinking_modec d| cxk rt | k s$n t d| dt | |dvrt d| d d}|| }t | }| d }| d }| d
}| d } | d }
| d
p| d } | dd } |rt | }|
rt |
}
|dk ri|t |pd z
}|r|dt | z z
}| r.|dt t | z z
}n(|dk r|st d| d| d}
|r|
dt | z z
}
| r.|
dt t | z z
}
|
d | z
}
|t |
z
}| |k r|dk r |t z
}nt|t z
}nh|dk rB|t | z
}| |k r|dk r |t z
}n,|t z
}n |dk r9| d z
}|| }|dk rE| d dk r,|d z }|| }|dk r| d dk ,| dk s4|dk r| d d k st d | d | | |z
}| d }|rt | |k st d |d k r|d!z
}|t | z
}|t | k r,|d"z
}| |k r|dk r|dt z z
}n|dt z z
}n|d k r| }d}d}|
rFd# |
D }
|dt t d$ |
% z z
}|pd}|dk rE| |k r?| s|
st d&| d'| d( t$ | pd) t z }|
s| r||z
}n3|t& |||* z
}nt) d+| |S ),Nr zIndex z* out of range for messages list of length )chatthinkingzInvalid thinking_mode `` r[ contentr response_formatr* reasoningreasoning_contentprefixFsystem)rk z
)schemar] zInvalid message for role `z`: z
# The user's message is: {}rh r\ r rZ assistantzInvalid messages at z:
z#No tool calls but found tool outputz
z
c g | ]D}t t | d t | ES )r$ )r r$ r% )r
r: r r` rB r' s r r z"render_message.. s\ #)) )" v.. 6y A A * r r5 )r r* zThinkingMode: z8, invalid message without reasoning_content/tool_calls `z` after last user message)rn )rm rk r* zUnknown role: )r_
ValueErrorrc r` r! r+ r r: rV r r r
r r r tool_calls_templater r< thinking_templater NotImplementedError)rd rW re promptmsg
last_user_idxr[ rk r rl r* rn is_prefixcontent_developerprev_assistant_idx
assistant_msgtool_call_orderassistant_tool_calls
thinking_parttool_calls_contentsummary_contents r render_messager sC
& & & &X & & & & UU U Uc(mm U U
000C=CCCDDD
F
5/C(22M 776??Dggi G GGG Egg /00O &&J ,,L8K0L0L%((I 0(// ?2:>>
x%,,W],CCC 3 f|E 2 22 2F f 7 > > // ?
F
J H$ H H3 H HII I > ,u*=*=!= = *B*I*I // +J + + "
> E Eg N NN#**3D*EEE M ! !mz&A&A * *FF ( (FF
#**7*;;; M ! !mz&A&A * *FF ( (FF
"QY !34
A%%-*;*;F*C*Cv*M*M ! # $%7 8M !A%%-*;*;F*C*Cv*M*M
QJJ!Q&& !!&))[88 ME M Mm M MNN N "44 , 0 0 > > $ D-A)B)Bo)U)U BCC C a . .F&--g->>> c"6 7 7 7 7 - -F
%%-:*E*E7755
"
",
J
&+>+E+E%$))J2G2G ,F , , #
"-R J & &5=+@+@%
K] K Klo K K K "((;L;RPR(SS$%
i o %FF ,33''- 4
FF ""94"9"9::: Mr rz c z g }|t | n|}t | D ]\ }}| d }|dv s||k r| | :|dk rUt j | }| dd | dd | | |S )Nr[ )r\ rp r rr rn rm )rc enumerater` r; copypop)rW rz messages_wo_thinkingrb ry r[ msg_wo_thinkings r drop_thinking_messagesr ' s 24*7*? X&&&] h''
9
9Swwv - - -
1E1E ' ' , , ,
[
"innO 3T : : : T 2 2 2 ' ' 8 8 8 r Tcontext
drop_thinkingadd_default_bos_tokenc |r|ng }|| z }|rt | dk rt nd}|dk r|rt | }t t | D ]'}|t |t | z || z
}(|S )Nr rj rh )re )r_ r r r^ r )rW re r r r
full_messagesrx rb s r encode_messagesr = s !(ggbGh&M/
MCLLA4E4EYY2F
""}".}==
S]]##
. #g,,
]
Mr textstopc t | }d }|D ](}| || }|dk r
||k r|}|})|r || | }|t | z ||fS || d }t | |d fS )NrY )r_ find)rd r r min_pos matched_stopsposrk s r _read_until_stopr T s $iiGL
ii5!! "99w G L (uW}%\***G\AAuvv,4yy'4''r c g }d }dt d}| t | k rt | |dt d|g \ } }}|dk rt d ||k rn|t d t | |dt ddt dg \ } }}t j d |t j
}t | d k rt d |d
}i } |dt dk rt | |dt dg \ } }
}t j d|
t j
} t | d k rt d | d
\ } }
}| | v rt d ||
f| | < t | |dt ddt dg \ } }}|dk rt d |dt dk t || }| | | t | k | ||fS )Nz<invokez>
zTool call format errorzMissing special token parameterz^\s*name="(.*?)">\n$)flagsrZ zTool name format errorr /z,^ name="(.*?)" string="(true|false)">(.*?)<$zParameter format errorzDuplicate parameter name)rC rD ) r r_ r RuntimeErrorrefindallDOTALLrO r; )rd r r*
stop_tokentool_calls_end_token_tool_name_content p_tool_namerC rD
param_contentparam_kv
param_namerF param_valuerk r( s r parse_tool_callsr h s ')JJ;
;;;
#d))
/ 40j0002FG
q*
:: 788 8 - - - 677 7/? 43j3335L*5L5L5LM0
0
, * j #%6bi
{ q 788 8 N 02 5
5 5 555/?t 7* 7 7 7 80 0 ,E=* z? i H
8}}!!"#;<<<.6qk +J Y&&"#=>>>%0&$9Ij !)9t 7* 7 7 79Pj9P9P9P Q* * &E7J % "#;<<<- 5
5 5 5550 -yIVVV )$$$e #d))
h *j ((r c ddg }}}d\ }}dt d}|dk d} }|r8t || t |g \ }}
}|
}|t k rt d t || t |g \ }}
}|
}||k rd} n|t k rt d | r@t || \ }}}t || t g \ }} }| rt d
t
| |k r |t d fv st d t t t t t fD ]} | |v s| |v rt d d
|||t | dS )Nrj )r Nz
<function_callsrh FzInvalid thinking formatTzInvalid summary formatz#Unexpected content after tool callszUnexpected content at endz#Unexpected special token in contentrr )r[ rk rn rm r* )
r r r r r r r_ r r r/ )
r re r rn r* rd r tool_calls_start_token is_thinkingis_tool_calling
content_deltatool_ends_textsp_tokens
r "parse_message_from_completion_textr s 57R
&O E: ?Z ? ? ?#0J#> K :+; 4,.DE,
,
(}j * + + + 899 9'7
ti!78( ($E=* $O+++ " " 788 8 F(8(E(E%z:,r s 6 1 3 0 0 0. 3 . . . % c % % %$ C $ $ $
C & S & & &A 3 A A A [ [ [ [) } # } } }L C P ; c : : :43 43 4 4 4 40 0 0
"S#X "3 " " " "*:: #CsCx $8 9: #s(^: : : :$T#sT#s(^';"; <= # 4S#X#7 C J J tCH~.J?BJJ J J J\ AE 4S>" 36: $sCx. 2 ,0 "& 4S>" $sCx.
!D
(
.( ((!%c(
3TCZ ( ( ( ((9)C 9)s 9) 9) 9) 9)~3S 3 3 3 3 3 3 3r