.`i)ddlZddlZddlmZddlmZmZddlmZddl m Z m Z ddl m Z ddlmZddlmZdd lmZe rdd lmZdd lmZdd lmZdd lmZne Ze Ze Ze ZeeZGddZGddZdS)N)abstractmethod)CallableSequence)cached_property) TYPE_CHECKINGAny) ToolServer) init_logger) is_list_of)import_from_path)ChatCompletionRequest) DeltaMessage)ResponsesRequest) TokenizerLikeceZdZdZdefdZedeee ffdZ e de e de fdZde e de e de fd Ze dee dee fd Ze d ed eezdeed zed zffdZe dededede e de e de e ded zfdZded zded zded zfdZd S)ReasoningParserz Abstract reasoning parser class that should not be used directly. Provided and methods should be used in derived classes. It is used to extract reasoning content from the model output. tokenizerc||_dSN)model_tokenizer)selfrargskwargss x/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/reasoning/abs_reasoning_parsers.py__init__zReasoningParser.__init__,s(returnc4|jSr)r get_vocab)rs rvocabzReasoningParser.vocab/s#--///r input_idscdS)a Check if the reasoning content ends in the input_ids. It is used in structured engines like `xgrammar` to check if the reasoning content ends in the model output. Parameters: input_ids: list[int] The input_ids of the model output. Returns: bool True if the reasoning content ends in the input_ids. Nrr!s ris_reasoning_endz ReasoningParser.is_reasoning_end5r delta_idsc,||S)a Check if the reasoning content ends in the input_ids on a decode step. It is used in structured engines like `xgrammar` to check if the reasoning content ends in the model output during a decode step. `input_ids` the entire model output and `delta_ids` are the last few computed tokens of the model output (like during a decode step). Parameters: input_ids: list[int] The entire model output. delta_ids: list[int] The last few computed tokens of the model output at the current decode step. Returns: bool True if the reasoning content ends in the `delta_ids` on a decode step. )r%)rr!r's ris_reasoning_end_streamingz*ReasoningParser.is_reasoning_end_streamingFs.$$Y///rcdS)z Extract content token ids from the input_ids. Parameters: input_ids: list[int] The input_ids of the model output. Returns: list[int] The extracted content from the input_ids. Nr#r$s rextract_content_idsz#ReasoningParser.extract_content_ids_r&r model_outputrequestNcdS)aE Extract reasoning content from a complete model-generated string. Used for non-streaming responses where we have the entire model response available before sending to the client. Parameters: model_output: str The model-generated string to extract reasoning content from. request: ChatCompletionRequest The request object that was used to generate the model_output. Returns: tuple[Optional[str], Optional[str]] A tuple containing the reasoning content and the content. Nr#)rr,r-s rextract_reasoningz!ReasoningParser.extract_reasoningkr&r previous_text current_text delta_textprevious_token_idscurrent_token_idsdelta_token_idscdS)az Instance method that should be implemented for extracting reasoning from an incomplete response; for use when handling reasoning calls and streaming. Has to be an instance method because it requires state - the current tokens/diffs, but also the information about what has previously been parsed and extracted (see constructor) Nr#)rr0r1r2r3r4r5s rextract_reasoning_streamingz+ReasoningParser.extract_reasoning_streamingr&r original_tag tool_servercdS)zz Instance method that is implemented for preparing the structured tag Otherwise, None is returned Nr#)rr8r9s rprepare_structured_tagz&ReasoningParser.prepare_structured_tags tr)__name__ __module__ __qualname____doc__rrrdictstrintr rrboolr%r)listr+r rtupler/rr7r r;r#rrrr$s )-))))0tCH~000_0  (3- D   ^ 0!#03;C=0 00002  T#Y  49    ^    ')99  sTz3:% &    ^ .     %SM  $C=  "#      ^ " Dj  $&  t      rrceZdZUdZiZeeeefe d<iZ eee eeffe d<e dedeefdZ e deefdZe dedeefdZe dd eed eeezd zd edd fdZe dedededd fdZe ddeeezd zd ed eed zdeeeeegeefzfdZe dedd fdZd S)ReasoningParserManagera  Central registry for ReasoningParser implementations. Supports two registration modes: - Eager registration via `register_module` - Lazy registration via `register_lazy_module` Each reasoning parser must inherit from `ReasoningParser`. reasoning_parsers lazy_parsersnamerc||jvr |j|S||jvr||Sd|}t d|d|)a  Retrieve a registered or lazily registered ReasoningParser class. If the parser is lazily registered, it will be imported and cached on first access. Raises: KeyError: if no parser is found under the given name. z, zReasoning parser 'z ' not found. Available parsers: )rHrI_load_lazy_parserjoinlist_registeredKeyError)clsrJ registereds rget_reasoning_parserz+ReasoningParserManager.get_reasoning_parsers 3( ( ((. . 3# # #((.. .YYs224455  S S Sz S S   rctt|jt|jzS)zDReturn names of all eagerly and lazily registered reasoning parsers.)sortedsetrHkeysrI)rPs rrNz&ReasoningParserManager.list_registeredsEc#/446677#c>N>S>S>U>U:V:VVWWWrc8|j|\}} tj|}t||}t |t st |d|d||j|<|S#t$r#}t d|||d}~wwxYw)z5Import and register a lazily loaded reasoning parser.z in z# is not a ReasoningParser subclass.z7Failed to import lazy reasoning parser '%s' from %s: %sN) rI importlib import_modulegetattr issubclassr TypeErrorrH Exceptionlogger exception)rPrJ module_path class_namemod parser_clses rrLz(ReasoningParserManager._load_lazy_parsers#&"24"8 Z )+66C j11Jj/:: !WW{WWW+5C !$ '       I      sAA,, B6BBNTmodule module_nameforcect|tstdt|| |jg}n@t |t r|g}n't|t r|}ntd|D]=}|s/||jvr&|j|}t|d|j ||j|<>dS)z-Register a ReasoningParser class immediately.z4module must be subclass of ReasoningParser, but got Nz,module_name must be str, list[str], or None.z is already registered at ) r[rr\typer< isinstancerAr rHrOr=)rPrerfrg module_namesrJexisteds r_register_modulez'ReasoningParserManager._register_modules&/22 UtF||UU   "O,LL  S ) ) L'=LL  S ) ) L&LLJKK K  1 1D XTS%:::/5$VV'BTVVWWW*0C !$ ' '  1 1rr`rac||f|j|<dS)a; Register a lazy module mapping for delayed import. Example: ReasoningParserManager.register_lazy_module( name="qwen3", module_path="vllm.reasoning.parsers.qwen3_reasoning_parser", class_name="Qwen3ReasoningParser", ) N)rI)rPrJr`ras rregister_lazy_modulez+ReasoningParserManager.register_lazy_modules#.z!:rct|tstdt|||||Sdtt dtt ffd }|S)z Register module with the given name or name list. it can be used as a decoder(with module as None) or normal function(with module as not None). z!force must be a boolean, but got N)rerfrgobjrc|j}|j}ttrg}nt tr}n|g}|D]}||fj|<|Sr)r=r<rjrAr rI)rqr`ranamesnrPrJs r _decoratorz:ReasoningParserManager.register_module.._decorator"sw.KJ$$$ %D#&& %#  @ @'2J&? ##Jr)rjrCr\rirmr)rPrJrgrerus`` rregister_modulez&ReasoningParserManager.register_module s%&& OMU MMNN N    D N N NM D1 d?6K        r plugin_pathctjtj|d} t ||dS#t $r t d||YdSwxYw)zq Import a user-defined reasoning parser by the path of the reasoning parser define file. rz#Failed to load module '%s' from %s.N)ospathsplitextbasenamer r]r^r_)rPrwrfs rimport_reasoning_parserz.ReasoningParserManager.import_reasoning_parser4s g&&rw'7'7 'D'DEEaH   [+ 6 6 6 6 6      5{K    FF  sA&B?B)NT)NTN)r<r=r>r?rHr@rArir__annotations__rIrE classmethodrRrDrNrLrCrmrorrvr}r#rrrGrGsW;=tCo!667<<rs ........%%%%%%%%%%%%%%777777######222222444444.------LM X  zzzzzzzzzaaaaaaaaaar