.`i UddlZddlZddlmZmZmZddlmZeeZ da ej dze d<dZ defdZdZd ZdS) N)REGISTRYCollectorRegistry multiprocess) init_logger_prometheus_multiproc_dircdtjvrStjatjtjd<t dtjdSt ddS)zFSet up prometheus multiprocessing directory if not already configured.PROMETHEUS_MULTIPROC_DIRz&Created PROMETHEUS_MULTIPROC_DIR at %szFound PROMETHEUS_MULTIPROC_DIR was set by user. This directory must be wiped between vLLM runs or you will find inaccurate metrics. Unset the variable and vLLM will properly handle cleanup.N) osenvirontempfileTemporaryDirectoryrnameloggerdebugwarningn/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/metrics/prometheus.pysetup_multiprocess_prometheusrs"33%-$?$A$A!1J1O -. 46O6T       5     rreturnctjd>tdt }t j||StS)zGet the appropriate prometheus registry based on multiprocessing configuration. Returns: Registry: A prometheus registry r Nz2Using multiprocess registry for prometheus metrics)r getenvrrrrMultiProcessCollectorr)registrys rget_prometheus_registryr'sN y+,,8 IJJJ$&&*8444 Orct}t|jD]0}t|drd|jvr||1dS)aUnregister any existing vLLM collectors from the prometheus registry. This is useful for testing and CI/CD where metrics may be registered multiple times across test runs. Also, in case of multiprocess, we need to unregister the metrics from the global registry. _namevllmN)rlist_collector_to_nameshasattrr unregister)r collectors runregister_vllm_metricsr$7s`H(677++ 9g & & +6Y_+D+D    * * *++rc$t}|dS tj}tj||t d|dS#t$r3}t dt|Yd}~dSd}~wwxYw)zShutdown prometheus metrics.Nz0Marked Prometheus metrics for process %d as deadz Error during metrics cleanup: %s) rr getpidrmark_process_deadrr Exceptionerrorstr)pathpides rshutdown_prometheusr.Gs %D |Aikk&sD111 GMMMMM AAA 7Q@@@@@@@@@AsAA B(B  B)r r prometheus_clientrrr vllm.loggerr__name__rrr __annotations__rrr$r.rrrr3s GGGGGGGGGG###### X  AE86=DDD   , !2     + + + A A A A Ar