.`i% d dl mZ d dlZd dlmZ d dlmZ d dlm Z d dl
m Z d dl m
Z
e e Z G d d e
ZdS )
)SequenceN)PreTrainedTokenizerBase)ChatCompletionRequest) DeltaMessage) init_logger)ReasoningParserc e Zd ZdZdef fd Zdee defdZ de
e de
e fdZ de d e
dee d
z e d
z f fd Zd ee d
ee defdZde de de dee dee dee ded
z fdZ xZS )HunyuanA13BReasoningParserah
Reasoning parser for Hunyuan A13B Model
HunyuanReasoningParser
This class implements a reasoning parser specifically designed
for the Hunyuan A13B Model. It is responsible for parsing and
extracting structured reasoning and answer segments from model
outputs that follow a specific pattern.
Key Features:
- For non-stream output , Recognizes and extracts reasoning ("think")
and answer ("answer") sections from text using regular expressions.
- For stream process, it requires a token id sequences to change the
reasoning state and other state so it maintains internal state to
manage parsing across multiple token.
think start: "
": [14023, 771, 397]
think ends: "
": [198, 524, 27963, 397, 27, 9399, 397]
response ends: "
": [524, 9399, 29]
tokenizerc j t j |g|R i | d| _ d| _ d| _ d| _ t
j d| j d| j d| j t j | _ t
j | j d| j dt j | _
g d | _ g d
| _ g d | _
g d | _ g d
| _ g d| _ g | _ g | _ d| _ ddg| _ d| _ | j | _ | j | _ d| _ g | _ d| _ d S )Nz \nz \n\nz\n\n\nz \nz(?:z(.*?)z)?(.*?)z(.*))6 )r
r S ) ;m r $ r )r r r r r r )r r r ) r
r r r r r r r r reasoningresponseidler )super__init__think_start_exprthink_end_exprresponse_start_exprresponse_end_exprrecompileDOTALLfull_match_reasoning_regexhalf_match_reasoning_regexthink_start_idsthink_start_ids_fastresponse_start_idsresponse_start_ids_fastresponse_end_idsfast_think_ids
buffered_text buffered_ids
current_state
all_statesexpected_sequenceexpected_sequence_sidesequence_index token_buffer text_buffer)selfr argskwargs __class__s /home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/hunyuan_a13b_reasoning_parser.pyr z#HunyuanA13BReasoningParser.__init__+ st 4T444V444 , -#< !/ *,* h4( h ht/G h hPTPf h h I+
+
'
+-*% J JD,D J J JBI+
+
' 1 0 0 $6$6$6!"G"G"G 'G'G'G$ 4 4 4 P P P (&
3 #!%!5 &*&?# input_idsreturnc | j dk S )Nr )r. r5 r; s r9 is_reasoning_endz+HunyuanA13BReasoningParser.is_reasoning_endR s !Z//r: c g S )N r> s r9 extract_content_idsz.HunyuanA13BReasoningParser.extract_content_idsU s
r: model_outputrequestNc | j | }|r9|d \ }}t | dk rd}t | dk rd}||fS | j }| | }|rp|d \ }}| | j r |dt | j }t | dk rd}t | dk rd}||fS d|fS )a Extract the reasoning content & content sections, respectively.
If the sequence doesn't match what we expect, i.e., the model generates
something else, all content is considered non-reasoning content.
Args:
model_output (str): Output of the model to be parsed.
request (ChatCompletionRequest): Request being processed.
Returns:
tuple[Optional[str], Optional[str]]: Tuple pair containing the
reasoning content and non-reasoning content.
r N)r$ findalllenr% endswithr )r5 rC rD re_matchr response_contentfallback_regexfallback_matchs r9 extract_reasoningz,HunyuanA13BReasoningParser.extract_reasoning\ s 2::<HH /*21+ 'I'9~~"" #$$))#' .. . 8'// == /*8*; 'I' (()?@@
T#34Rs4;Q7R7R6R4R#S 9~~"" #$$))#' .. .\!!r: subsequencesequencec |sdS d}|D ]&}|t | k r||| k r|dz
}'|t | k S )NFr )rG )r5 rN rO sub_idxnums r9 !_is_strict_increasing_subsequencez.check_token_with_sequence sg !V++t/AW/L/LT 3D4G HH Q ;D.check_last_token s !V++t/AW/L/L '!+c$2M.N.NNN ! $ 3 "&"9 $ 5 ?##q(((( " L L L L L J J J J J 7 6u = = / L $ $U + + +
* 1 $ &&
&%//)0D&-DD*262ND//'722)3D&-BD**':55)/D&-AD*262KD/ '(#$&!#%
LS):%;%;a%?%?#'#3j#@ &'#$&!#% %00'2BDQQQQ'$@PQQQQ %00'*dKKKK'$
KKKK tr: )__name__
__module__ __qualname____doc__r r r intboolr? listrB strr tuplerM rT r rj
__classcell__)r8 s @r9 r
r
s .% "9 % % % % % % N0(3- 0D 0 0 0 0T#Y 49 (" ("*?(" sTz3:% &(" (" (" ("T
+#C=
+4r} s % $ $ $ $ $ 0 0 0 0 0 0 A @ @ @ @ @ # # # # # # * * * * * * X ] ] ] ] ] ] ] ] ] ]r: