&`i ddlZddlZddlmZmZmZmZddlmZm Z m Z ddl m Z m Z ddlmZeje Z dde deded eed eed ef d Zed de d eeeeefffdZeZdS)N)AnyDictOptionalTuple)CONTROL_LOOP_INTERVAL_S'SERVE_AUTOSCALING_DECISION_COUNTERS_KEYSERVE_LOGGER_NAME)AutoscalingConfigAutoscalingContext) PublicAPIautoscaling_configtotal_num_requestsnum_running_replicasoverride_min_replicasoverride_max_replicasreturnc|dkrtd||z}||z }|dkr|}n|}d|dz |zz}t j||z} t j||z|kr | |kr| dz} |j} |j} ||} ||} t| t| | } | S)a8Returns the number of replicas to scale to based on the given metrics. Args: autoscaling_config: The autoscaling parameters to use for this calculation. current_num_ongoing_requests (List[float]): A list of the number of ongoing requests for each replica. Assumes each entry has already been time-averaged over the desired lookback window. override_min_replicas: Overrides min_replicas from the config when calculating the final number of replicas. override_max_replicas: Overrides max_replicas from the config when calculating the final number of replicas. Returns: desired_num_replicas: The desired number of replicas to scale to, based on the input metrics and the current number of replicas. rz!Number of replicas cannot be zero) ValueErrorget_target_ongoing_requestsget_upscaling_factorget_downscaling_factormathceil min_replicas max_replicasmaxmin) r rrrrtarget_num_requests error_ratioscaling_factorsmoothed_error_ratiodesired_num_replicasrrs p/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/serve/autoscaling_policy.py_calculate_desired_num_replicasr%s#2q  <=== 6688;OO,.AAKa+@@BB+BBDDqN BC9%9#?#?  s7-D#DEEE E E $8 !rGs ------------ CBBBBBBB******  , - -.2-1 E E )E E E $E? E $E? E  E E E E P WX/ X/ 3S#X X/X/X/X/vEr&