&`idZddlZddlZddlmZddlmZmZmZedZ GddZ e Z ded e fd ed ee ffd Z dS) z Generic model definitions for common utilities. These models represent generic concepts that can be used by both serve and batch components. N)partial) AwaitableCallableTypeVarTc$eZdZdZdZdefdZdS)GlobalIdManagerz7Thread-safe global ID manager for assigning unique IDs.cDd|_tj|_dS)Nr)_counter threadingLock_lockselfs s/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/llm/_internal/common/models.py__init__zGlobalIdManager.__init__s ^%% returncr|j5|xjdz c_|jcdddS#1swxYwYdS)zGet the next unique ID.N)rr rs rnextzGlobalIdManager.nexts Z ! ! MMQ MM= ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !s ,00N)__name__ __module__ __qualname____doc__rintrrrr r sDAA&&&!c!!!!!!rr _func.rc,dtjffd }|S)zTake a blocking function, and run it on in an executor thread. This function prevents the blocking function from blocking the asyncio event loop. The code in this function needs to be thread safe. rcxtj}tg|Ri|}|d|S)N)executorfunc)asyncioget_event_looprrun_in_executor)argskwargsloopr"rs r_async_wrapperz"make_async.._async_wrapper,sG%''u.t...v..##T#===r)r#Future)rr)s` r make_asyncr+%s2>7>>>>>>> r) rr#r functoolsrtypingrrrrr global_id_managerr+rrrr/s////////// GCLL ! ! ! ! ! ! ! !$O%% hsAv& 8C14E+F      r