&`i pddlZddlmZddlmZmZddlmZejdej de dd ej d e d d ej de dd ej de d d de de de de fdZ e dkr e dSdS)N)serve) BenchmarkerHello)DeploymentHandlez'Benchmark deployment handle throughput.)helpz --batch-sizedzBNumber of requests to send to downstream deployment in each trial.)typedefaultrz--num-replicasz0Number of replicas in the downstream deployment.z --num-trialsz)Number of trials of the benchmark to run.z--trial-runtimez:Duration to run each trial of the benchmark for (seconds). batch_size num_replicas num_trials trial_runtimec `tjtj|ddi}t j|}|j|||\}}td d|d|d||dS) Nnum_cpusr)rray_actor_options)r rrz3DeploymentHandle throughput {}: {} +- {} requests/sz(num_replicas=z , batch_size=)) rbindroptionsrrunrun_throughput_benchmarkremoteresultprintformat)r rrrapphmeanstddevs /home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/serve/_private/benchmarks/handle_throughput.pymainr"s>   %*a   $&&  C  )C..A-44#5 fhh D&  =DD E\ E E E E E    __main__)clickrayr$ray.serve._private.benchmarks.commonrrray.serve.handlercommandoptionintfloatr"__name__r#r!r/sy CCCCCCCC------=>>>   M   ;   4   E       ?>28 zDFFFFFr#