-`idZddlZddlmZddlmZddlmZmZee Z de de e e efdee e fdzfd Zde e e effd Zde dee e fdzfd ZdS) zK Utility functions that create ORCA endpoint load report response headers. N)Mapping) init_logger)Gaugeget_metrics_snapshotmetrics_format named_metricsreturnc|dvr"tdtdSi}dd|Di}|dkr(dd|D}d ||d <n2|d krd t j||d <td ||S)a Creates ORCA headers named 'endpoint-load-metrics' in the specified format and adds custom metrics to named_metrics. ORCA headers format description: https://docs.google.com/document/d/1C1ybMmDKJIVlrbOLbywhu9iRYo4rilR-cT50OTtOFTs/edit?tab=t.0 ORCA proto https://github.com/cncf/xds/blob/main/xds/data/orca/v3/orca_load_report.proto Parameters: - metrics_format (str): The format of the header ('TEXT', 'JSON'). - named_metrics (List[Tuple[str, float]]): List of tuples with metric names and their corresponding double values. Returns: - Optional[Mapping[str,str]]: A dictionary with header key as 'endpoint-load-metrics' and values as the ORCA header strings with format prefix and data in with named_metrics in. )textjsonzAWarning: `%s` format is not supported in the ORCA response headerNrcni|]2\}}t|tt|t/||3S isinstancestrfloat.0 metric_namevalues x/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/entrypoints/openai/orca_metrics.py z&create_orca_header..-sR   " U+s++ 1;5%0H0H    r z, cxg|]7\}}t|tt|t/d|d|8S)znamed_metrics.=rrs r z&create_orca_header..7s`   &Kk3// 5?ue4L4L 666u66   rzTEXT zendpoint-load-metricsr zJSON zCreated ORCA header %s)lowerloggerwarningformatjoinr dumpsinfo)rrheader orca_reportnative_http_headers rcreate_orca_headerr's(%555 O    t F  &3   K''!YY  *7     +G2D*F*F&''     6 ) )*K$*[2I2I*K*K&' KK(&111 Mrcg}ddd}t}|D]i}||j}|Kt|tr6|t |t|jfj|S)a  Collects current metrics from Prometheus and returns some of them in the form of the `named_metrics` list for `create_orca_header()`. Parameters: - None Returns: - list[tuple[str, float]]: List of tuples of metric names and their values. kv_cache_usage_percnum_requests_waiting)zvllm:kv_cache_usage_perczvllm:num_requests_waiting) rgetnamerrappendrrr)rprometheus_to_orca_metricsmetricsmetric orca_names r!get_named_metrics_from_prometheusr2Is.0M%:%;""#$$GHH.226;??   Z%>%>  #i..% 2E2E!F G G G rcF|sdSt}t||S)a Creates ORCA headers named 'endpoint-load-metrics' in the specified format. Metrics are collected from Prometheus using `get_named_metrics_from_prometheus()`. ORCA headers format description: https://docs.google.com/document/d/1C1ybMmDKJIVlrbOLbywhu9iRYo4rilR-cT50OTtOFTs/edit?tab=t.0 ORCA proto https://github.com/cncf/xds/blob/main/xds/data/orca/v3/orca_load_report.proto Parameters: - metrics_format (str): The format of the header ('TEXT', 'JSON'). Returns: - Optional[Mapping[str,str]]: A dictionary with header key as 'endpoint-load-metrics' and values as the ORCA header strings with format prefix and data in with named_metrics in. N)r2r')rrs rmetrics_headerr4ds, t577M nm < <r<s ############>>>>>>>> X  66(,U3:->(?6 S#X6666r4c5j0A+B6=3=738+