.`ijddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z e e ZGddZGdd Zdd Zdd Zd ed efdZdeeded efdZdS)N)Counter)suppress)Any) init_loggerc6eZdZdZddedzddfdZdefdZdS) GCDebugConfigz Config for GC Debugger. - 0: disable GC debugger - 1: enable GC debugger with gc.collect elapsed times - '{"top_objects":5}': enable GC debugger with top 5 collected objects N gc_debug_confreturncd|_d|_|r|dkrn|dkrd|_nt tj|}d|_|dd|_n<#t $r/d|_t dtj YnwxYwt dt|dS) NF01T top_objectsz!Failed to parse VLLM_GC_DEBUG(%s)zGC Debug Config. %s) enabledrjsonloadsget Exceptionloggererrorenvs VLLM_GC_DEBUGdebugstr)selfr json_confs g/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/utils/gc_utils.py__init__zGCDebugConfig.__init__s" " V  4 4  c ! !DLL V J}55 # #,==#C#C   V V V$  @$BTUUUUU V  *CII66666s6A6BBc&d|jd|jS)Nzenabled:z ,top_objects:)rr)rs r__repr__zGCDebugConfig.__repr__*sG$,GGT5EGGGN)__name__ __module__ __qualname____doc__rrr r!rrrsk77cDj7D7777$H#HHHHHHr!rcFeZdZdZdeddfdZdedeeefddfdZ dS) GCDebuggerz Debugger for GC which logs helpful information for GC understanding. To enable, you should call maybe_attach_gc_debug_callback in the process. configr Nc`||_tj|_d|_d|_dS)Nr)r*time monotonic_ns start_time_ns num_objectsgc_top_collected_objects)rr*s rrzGCDebugger.__init__4s2 "&"3"5"5 !.0%%%r!phaseinfoc |d}|dS|dkratj|_t j|}t ||_t||j j |_ dS|dkrvtj|jz dz }t d|t|dd|j||j r d |j nd dSdS) zA Handles a GC event (e.g. GC start or GC finish) generationNstartstopg.AzSGC took %.3fms to complete. Collected %s objects (out of %d) in GC generation %d.%s collected?z Top collected objects: r,)rr-r.r/gc get_objectslenr0!_compute_top_gc_collected_objectsr*rr1rr3r)rr2r3r5objects elpased_mss rhandlezGCDebugger.handle=sXXl++   F G  "&!2!4!4D nZ00G"7||D ,M0--D ) ) )f__+--0BBcIJ KKJDHH[#..// 4P1NPPP      _r!) r#r$r%r&rrrdictintr@r'r!rr)r).sq 0}00000 C tCH~ $      r!r)r ctjdtjdtjdtjdS)z Freeze all objects tracked by the garbage collector. It should be invoked after server init / warmup, to reduce GC overhead from static objects during serving time. rN)r:collectfreezer'r!rfreeze_gc_heaprH`s:JqMMMJqMMMJqMMMIKKKKKr!cttj}|jrXt |dt dt t tfddffd }tj |dSdS)zI Attached a callback for GC debug when VLLM_GC_DEBUG is enabled. r2r3r Nc4||dSr")r@)r2r3debuggers r gc_callbackz3maybe_attach_gc_debug_callback..gc_callbackws OOE4 ( ( ( ( (r!) rrrrr)rrArBr: callbacksappend)r*rLrKs @rmaybe_attach_gc_debug_callbackrOos4- . .F ~))&11 )s )$sCx. )T ) ) ) ) ) ) K((((( ))r!ocd}tt5dt|d}dddn #1swxYwYtt ||S)z Detailed object type. TODO(Jialin): Further enhance the detailed type with element types for easier debugging. We tried but occasionally it would run into signals which kills the engine. r,z(size:)N)rrr<rtype)rPsize_strs r_compute_detailed_typerU}sH )  &&%CFF%%%&&&&&&&&&&&&&&&$q''ll &H & &&s 7;;r>topc|dkrdSd|D}ddt||DS)z+ Group collected objects by types. rr,c,g|]}t|Sr')rU).0rPs r z5_compute_top_gc_collected_objects..s!???!*1--???r! c3,K|]\}}|dd|VdS)z>5:Nr')rY object_typecounts r z4_compute_top_gc_collected_objects..sK K ###k##r!)joinr most_common)r>rV object_typess rr=r=sm axxr??w???L 99"),"7"7"C"CC"H"H  r!)r N)r:rr- collectionsr contextlibrtypingr vllm.envsr vllm.loggerrr#rrr)rHrOrrUlistrBr=r'r!rrjse ###### X  HHHHHHHH