%`i_LddlZddlZddlZddlZddlmZddlmZddlm Z ddl Z ddl m Z m Z ddlmZddlmZddlmZdd lmZdd lmZmZdd lmZmZdd lmZmZmZdd l m!Z!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)ej*e+Z,dZ-e"GddZ.dS)N)wraps)Lock)Optional)Languagecross_language)ray_option_utils))_warn_if_using_deprecated_placement_group) pickle_dumps)wrap_auto_init)client_mode_convert_functionclient_mode_should_convert)get_runtime_env_info#parse_runtime_env_for_task_or_actor)STREAMING_GENERATOR_RETURNObjectRefGeneratorPythonFunctionDescriptor) DeveloperAPI PublicAPI)+_configure_placement_group_based_on_context) PlacementGroupSchedulingStrategy)_inject_tracing_into_function_tracing_task_invocationceZdZdZdZdZdZdZdZe e d de e fd Z ed ZdS) RemoteFunctiona A remote function. This is a decorated function. It can be used to spawn tasks. Attributes: _language: The target language. _function: The original function. _function_descriptor: The function descriptor. This is not defined until the remote function is first invoked because that is when the function is pickled, and the pickled function is used to compute the function descriptor. _function_name: The module and function name. _num_cpus: The default number of CPUs to use for invocations of this remote function. _num_gpus: The default number of GPUs to use for invocations of this remote function. _memory: The heap memory request in bytes for this task/actor, rounded down to the nearest integer. _label_selector: The label requirements on a node for scheduling of the task or actor. _fallback_strategy: Soft constraints of a list of decorator options to fall back on when scheduling on a node. _resources: The default custom resource requirements for invocations of this remote function. _num_returns: The default number of return values for invocations of this remote function. _max_calls: The number of times a worker can execute this function before exiting. _max_retries: The number of times this task may be retried on worker failure. _retry_exceptions: Whether application-level errors should be retried. This can be a boolean or a list/tuple of exceptions that should be retried. _runtime_env: The runtime environment for this task. _decorator: An optional decorator that should be applied to the remote function invocation (as opposed to the function execution) before invoking the function. The decorator must return a function that takes in two arguments ("args" and "kwargs"). In most cases, it should call the function that was passed into the decorator and return the resulting ObjectRefs. For an example, see "test_decorated_function" in "python/ray/tests/test_basic.py". _function_signature: The function signature. _last_export_cluster_and_job: A pair of the last exported cluster and job to help us to know whether this function was exported. This is an imperfect mechanism used to determine if we need to export the remote function again. It is imperfect in the sense that the actor class definition could be exported multiple times by different workers. _scheduling_strategy: Strategy about how to schedule this remote function. c  tj|rtd|_jdpd}|dkrjddt fddDr djd<t jD]2\}}td|z|||j 3tj _ d jvrj jd <d _ j rtj d d _ |_tj|_|_d_t)_|jdz|jz_|_|t4jk_t;|dd_d_tAj!_"tG|fd}|_$dS)Nz'async def' should not be used for remote tasks. You can wrap the async function with `asyncio.run(f())`. See more at:https://docs.ray.io/en/latest/ray-core/actors/async_api.html num_gpusr max_callscLg|] }|j|piv!S)_default_optionsget).0sselfs g/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/remote_function.py z+RemoteFunction.__init__..ssD   d+//228b9   )nsightz rocprof-sys_ runtime_envFTis_job_runtime_env serialize.__ray_invocation_decorator__c:jdj||djS)N)serialized_runtime_env_infoargskwargsr)_remote!_serialized_base_runtime_env_infor )r4r5r$s r% _remote_proxyz.RemoteFunction.__init__.._remote_proxys<4<,0,R'  r')%inspectiscoroutinefunction ValueErrorr r!anyr task_optionsitemssetattr default_valuer _runtime_envr7r _languageisgeneratorfunction _is_generator _function_function_signaturer _inject_lock __module____name___function_name_function_descriptorrPYTHON_is_cross_languagegetattr _decorator_last_export_cluster_and_jobuuiduuid4_uuidrremote) r$languagefunctionfunction_descriptorr=rkvr8s ` r%__init__zRemoteFunction.__init__[sA  &x 0 0 P  !-(,,Z88=A qLLT266{DIIQ     2     R23D !+ . %17799 I IDAq D#'<#3#3Aq#G#G H H H H?@QRR D1 1 1373DD !- 024.   5I!#(666D 2 "$8BB!#'  FF&1C7(:KK$7!"*ho"=!(,JDQQ,0)Z\\  x      $ r'cBtd|jd|jd)Nz@Remote functions cannot be called directly. Instead of running 'z ()', try 'z .remote()'.) TypeErrorrJ)r$r4r5s r%__call__zRemoteFunction.__call__s> 5. 5 5' 5 5 5   r'c>|j}|d=|SNrG)__dict__copy)r$attrss r% __getstate__zRemoteFunction.__getstate__s" ""$$ . ! r'cf|j|t|jd<dSr_)r`updater)r$states r% __setstate__zRemoteFunction.__setstate__s. U###(, n%%%r'c |||j}|ddtj||tjd|jd|vr8tdd<drtdddGfdd }|S) a;Configures and overrides the task invocation parameters. The arguments are the same as those that can be passed to :obj:`ray.remote`. Overriding `max_calls` is not supported. Args: num_returns: It specifies the number of object refs returned by the remote function invocation. num_cpus: The quantity of CPU cores to reserve for this task or for the lifetime of the actor. num_gpus: The quantity of GPUs to reserve for this task or for the lifetime of the actor. resources (Dict[str, float]): The quantity of various custom resources to reserve for this task or for the lifetime of the actor. This is a dictionary mapping strings (resource names) to floats. label_selector (Dict[str, str]): If specified, the labels required for the node on which this actor can be scheduled on. The label selector consist of key-value pairs, where the keys are label names and the value are expressions consisting of an operator with label values or just a value to indicate equality. fallback_strategy (List[Dict[str, Any]]): If specified, expresses soft constraints through a list of decorator options to fall back on when scheduling on a node. accelerator_type: If specified, requires that the task or actor run on a node with the specified type of accelerator. See :ref:`accelerator types `. memory: The heap memory request in bytes for this task/actor, rounded down to the nearest integer. object_store_memory: The object store memory request for actors only. max_calls: This specifies the maximum number of times that a given worker can execute the given remote function before it must exit (this can be used to address memory leaks in third-party libraries or to reclaim resources that cannot easily be released, e.g., GPU memory that was acquired by TensorFlow). By default this is infinite for CPU tasks and 1 for GPU tasks (to force GPU tasks to release resources after finishing). max_retries: This specifies the maximum number of times that the remote function should be rerun when the worker process executing it crashes unexpectedly. The minimum valid value is 0, the default is 3 (default), and a value of -1 indicates infinite retries. runtime_env (Dict[str, Any]): Specifies the runtime environment for this actor or task and its children. See :ref:`runtime-environments` for detailed documentation. retry_exceptions: This specifies whether application-level errors should be retried up to max_retries times. scheduling_strategy: Strategy about how to schedule a remote function or actor. Possible values are None: ray will figure out the scheduling strategy to use, it will either be the PlacementGroupSchedulingStrategy using parent's placement group if parent has one and has placement_group_capture_child_tasks set to true, or "DEFAULT"; "DEFAULT": default hybrid scheduling; "SPREAD": best effort spread scheduling; `PlacementGroupSchedulingStrategy`: placement group based scheduling; `NodeAffinitySchedulingStrategy`: node id based affinity scheduling. enable_task_events: This specifies whether to enable task events for this task. If set to True, task events such as (task running, finished) are emitted, and available to Ray Dashboard and State API. See :ref:`state-api-overview-ref` for more details. _labels: The key-value labels of a task. Examples: .. code-block:: python @ray.remote(num_gpus=1, max_calls=1, num_returns=2) def f(): return 1, 2 # Task g will require 2 gpus instead of 1. g = f.options(num_gpus=2) rNT) in_optionsr+Fr-c:eZdZfdZefdZdS)+RemoteFunction.options..FuncWrapperc&jd||dS)N)r4r5r3r)r6)r$r4r5func_clsr3updated_optionss r%rTz2RemoteFunction.options..FuncWrapper.remote$s7'x'!0K& r'c6ddlm}|j||S)z For Ray DAG building that creates static graph from decorated class or functions. r FunctionNode)ray.dag.function_noderqrE)r$r4r5rqrmrns r%bindz0RemoteFunction.options..FuncWrapper.bind,s0 ?>>>>>#|H$6foVVVr'N)rIrH __qualname__rTrrs)rmr3rnsr% FuncWrapperrk#sj        W W W W W\ W W Wr'ru) r rapoprupdate_optionsvalidate_task_optionsr7rr)r$r=default_optionsrurmr3rns @@@r%optionszRemoteFunction.optionssX/4466 K...*9/<XX.4PPPP'+&L# L ( (-P ...OM *}- .B#M2',"///+  W W W W W W W W W W W W&{}}r'Nr3c  |ddtrt||fi|Stjjjjtjjj krddl m }| dj 5jGtj_tjjj_dddn #1swxYwYjsjjkrqt/jjj_t7jdjj_j_j|in|}|gn|}t@j!"D]l\}}|dkrCtFj$%d|j&|_&tO|j&|_&|%||j&||<m|dd|d |d }|d } |d } |d |d j(rdnddkrdndkrtj)j*|dd|d|dtWtXtZfrt[dndtWt\st_|dtjj01|tWt\rmtWt\rj2}j3} j4} | j5} tm| | ijj7|}|j8st]|| | ndtrrtsj|%d |%d|%d|%d fd} j::| } | ||S)z)Submit the remote function for execution.rNr) usage_libcorez!Could not serialize the function max_retriesRAY_TASK_MAX_RETRIESnameplacement_groupplacement_group_bundle_index#placement_group_capture_child_tasksscheduling_strategy num_returns streamingr)dynamic#_generator_backpressure_num_objectsretry_exceptionsT)rDEFAULTenable_task_events_labelslabel_selectorfallback_strategycrjrtj||}n9|s |s jsg}n+tjjj||}jtj j j krjr Jdj jj|  nd jpd }d_ t"kr-t%|dksJ|d}t'|St%|dkr|dSt%|dkr|SdS)Nz:Cross language remote function cannot be executed locally.r,z{}r'r)r)rMr _format_argsrFray_common signature flatten_argsmode_privateworker LOCAL_MODE core_worker submit_taskrBrKdebugger_breakpointrlenr)r4r5 list_args object_refs generator_refrr"generator_backpressure_num_objectsrlabelsr~rr resourcesretry_exception_allowlistrrr$r3rs r% invocationz*RemoteFunction._remote..invocations& *7fMM  & 1I  K1>>,dF {cl1<<</PPOPP/ ,88)(b )#*+3t2"!#K**-F &888;''1,,,, +A )-@@@;1$$"1~%[!!A%%""&%r');rvr r rrr global_workercheck_connectedr WORKER_MODEray._common.usager|record_library_usagerGrFrrErrextract_signaturerMrPcurrent_cluster_and_jobr from_functionrSrKr repr_pickled_functionfunction_actor_managerexportrr=r>osenvironr!r@intrD_rayletr isinstancelisttuplerr utilsresources_from_ray_optionsrrr-should_capture_child_tasks_in_placement_groupr function_nameis_empty_task_launch_hookrO)r$r4r5r3r=r|rXrYrrrrrrrrrr~rrrrrrrs` ` @@@@@@@@@@@@@r%r6zRemoteFunction._remote8s d+++ % ' ' T/dFSSlSS S$2   ;#,-9 9 9 4 3 3 3 3 3  * *6 2 2 2   '/!>t~!N!N+.;+@+R+RN,,(               ' 71V5SSS(@(N ))D %&2TD4M4RTT&&D " 170ND -  ) 0 0 6 6 6~6\rrt%17799 C CDAqM!!#%*..*AO###&ao"6"6*..q!/BBLOO d+++F#&'89'34R'S$.: 1/ +++@A"=1  ! )  ) # #KK K ' '+@K-9 1. * . 513 ."=1 '(:; &u 6 6 -(-.>(?(? %#  (, %  &j !A/ / & 6lA F F FK%@@NN  &* !A+ + &-/OPP "5"E'D-(K43:H4J3,)7 / O#+ 0&F#07''## '0#  Y d7DW X X X*--.BCC!!),,%))*:;;(,,-@AA- #- #- #- #- #- #- #- #- #- #- #- #- #- #- #- #- #- #- #^ ? &44Jz$'''s.AD  D D c>ddlm}||j|||jS)zk For Ray DAG building that creates static graph from decorated class or functions. rrp)rrrqrEr )r$r4r5rqs r%rszRemoteFunction.binds1 766666|DND&$:OPPPr')NNN)rIrHrt__doc__rZr]rcrgrzr rrstrr6rrsrr'r%rr(s//bP$P$P$d    ///xxxt59 U(U(&.c] U(U(U(^U(nQQ\QQQr'r)/r9loggingrrQ functoolsr threadingrtypingrray._common.signaturerrr ray._commonrray._common.ray_option_utilsr ray._common.serializationr ray._private.auto_init_hookr ray._private.client_mode_hookr r ray._private.utilsrr ray._rayletrrrray.util.annotationsrrray.util.placement_grouprray.util.scheduling_strategiesrray.util.tracing.tracing_helperrr getLoggerrIloggerrrrr'r%rs ((((((((((((((RRRRRR222222666666YXXXXXXX 98888888PPPPPPKKKKKK  8 $ $ qQqQqQqQqQqQqQ qQqQqQr'