.`i
d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
m Z d dl m
Z
d dlmZ ee Z G d d
e Zd S ) )Sequence)ChatCompletionRequest) DeltaMessage) init_logger)ReasoningParser)DeepSeekR1ReasoningParser)IdentityReasoningParser)
TokenizerLikec e Zd ZdZdef fd Zdee defdZ dee dee defdZ
de e de e fd Z d
e
d edee
d z e
d z f fd
Zde
de
de
dee dee dee ded z fdZ xZS )Holo2ReasoningParsera
Reasoning parser for the Holo2 models which are based on Qwen3.
The Holo2 model uses ... tokens to denote reasoning text but
is part of the chat template. This parser extracts the reasoning content until
in the model's output.
The model provides a switch to enable or disable reasoning
output via the 'thinking=False' parameter.
Chat template args:
- thinking: Whether to enable reasoning output (default: True)
Parsing rules on model output:
- thinking == False
-> Model output is treated as purely the content |content|
- thinking == True
-> Model output is |reasoning_content||content|
tokenizerc b t j |g|R i | | di pi }t | dd }t | dd }|o|}|rt |g|R i || _ d S t
|g|R i || _ d S )Nchat_template_kwargsthinkingTenable_thinking)super__init__getboolr _parserr )selfr
argskwargs chat_kwargsr r __class__s y/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/holo2_reasoning_parser.pyr z Holo2ReasoningParser.__init__+ s 4T444V444 jj!7<<B
D99:: {/@$ G GHH/ O4YPPPPPPDLLL29NtNNNvNNDLLL input_idsreturnc 6 | j | S N)r is_reasoning_endr r s r r" z%Holo2ReasoningParser.is_reasoning_end< s |,,Y777r delta_idsc 8 | j || S r! )r is_reasoning_end_streaming)r r r$ s r r& z/Holo2ReasoningParser.is_reasoning_end_streaming? s |66y)LLLr c 6 | j | S r! )r extract_content_idsr# s r r( z(Holo2ReasoningParser.extract_content_idsD s |// :::r model_outputrequestNc 8 | j || S r! )r extract_reasoning)r r) r* s r r, z&Holo2ReasoningParser.extract_reasoningG s |--lGDDDr
previous_text current_text
delta_textprevious_token_idscurrent_token_idsdelta_token_idsc @ | j |||||| S r! )r extract_reasoning_streaming)r r- r. r/ r0 r1 r2 s r r4 z0Holo2ReasoningParser.extract_reasoning_streamingL s0 |77
r )__name__
__module__ __qualname____doc__r
r r intr r" r& listr( strr tupler, r r4
__classcell__)r s @r r r s *O- O O O O O O"8(3- 8D 8 8 8 8M!# M3;C=M
M M M M
;T#Y ;49 ; ; ; ;E E*?E sTz3:% &E E E E
%SM
$C=
"#
r r N)collections.abcr 0vllm.entrypoints.openai.chat_completion.protocolr 'vllm.entrypoints.openai.engine.protocolr vllm.loggerr vllm.reasoningr +vllm.reasoning.deepseek_r1_reasoning_parserr (vllm.reasoning.identity_reasoning_parserr vllm.tokenizersr
r5 loggerr r r rH s % $ $ $ $ $ A @ @ @ @ @ # # # # # # R Q Q Q Q Q L L L L L L ) ) ) ) ) ) X G
G
G
G
G
? G
G
G
G
G
r