.`io#jddlmZddlZddlZddlZddlZddlZddlmZm Z ddl m Z ddl m Z ddlZddlmZddlmZddlmZddlmZd d lmZmZeeZd Zd Zd2dZejd3dZ ejdZ!d4dZ"dZ#dZ$dej%fd5d"Z&d6d(Z'd7d8d+Z(d9d,Z)d:d;d/Z*d A BqEExxzz H Q rcDtjddkrdSg}tr?ddl}|jtjd<|dtr|dn#tr|dtr|d |r?t d d |dtjd<dSdS) zWCheck if we need to force the use of the `spawn` multiprocessing start method. VLLM_WORKER_MULTIPROC_METHODspawnNr RAY_ADDRESSz&In a Ray actor and can only be spawnedzCUDA is initializedzXPU is initializedz4WSL is detected and NVML is not compatible with forkzWe must use the `spawn` multiprocessing start method. Overriding VLLM_WORKER_MULTIPROC_METHOD to 'spawn'. See https://docs.vllm.ai/en/latest/usage/troubleshooting.html#python-multiprocessing for more information. Reasons: %sz; )rrr!r rayget_runtime_context gcs_addressappendr r r rrjoin)reasonsrBs r_maybe_force_spawnrHrs( z~~455@@GA  $'$;$;$=$=$I =!?@@@-,----   -+,,, xxOMNNN = 0 IIg      6= 1222 = =rc^ttj}tj|S)aJGet a multiprocessing context with a particular method (spawn or fork). By default we follow the value of the VLLM_WORKER_MULTIPROC_METHOD to determine the multiprocessing method (default is fork). However, under certain conditions, we may enforce spawn and override the value of VLLM_WORKER_MULTIPROC_METHOD. )rHr'r?multiprocessing get_context) mp_methods rget_mp_contextrMs)1I  &y 1 11rnamesuffixprefixNonecz ddl}n#t$rYdSwxYw|r|d|}||d|dS)z3Set the current process title with optional suffix.rN_z::) setproctitle ImportError)rOrPrQrUs rset_process_titlerWs}  "!!!!1141122222s  filer worker_namepidintctjr d|d|dntd|d|dtdjd fd }d _|_d S) z5Add colored prefix to file output for log decoration.(z pid=z) ) src^|sdSjr d}|d|x}dkr]|dz }||||t|kr d_dS|}|d|x}dk]||dd_dS)Nr r TF)start_new_linefindlen)r`idxnext_idxrX file_writerQs rwrite_with_prefixz&_add_prefix..write_with_prefixs  F    Jv   66$,,,x33 MH JqX ' ' '3q66!!&*# Jv   C66$,,,x33  1STT7#rTN)r`r)r'NO_COLORCYANRESETwriterd)rXrYrZrjrirQs` @@r _add_prefixros }<.[..s...;;;;;S;;5;;;J$$$$$$$$"D"DJJJr process_name str | NonectjsdS|%tj}t j}ttj ||ttj ||dS)z8Decorate stdout/stderr with process name and PID prefix.N) r'VLLM_CONFIGURE_LOGGINGrMcurrent_processrOrgetpidror)r*stderr)rprZs r decorate_logsrwsm  &%''7799> )++C L#... L#.....rc tj|}n#tj$rYdSwxYw|d}|D]W}t jt 5tj|j tj dddn #1swxYwYXt jt 5tj|tj ddddS#1swxYwYdS)z Kills all descendant processes of the given pid by sending SIGKILL. Args: pid (int): Process ID of the parent process NT) recursive) psutilProcess NoSuchProcesschildren contextlibsuppressProcessLookupErrorrkillrZsignalSIGKILL)rZparentr}childs rkill_process_treersm$$  ..H//  !3 4 4 / / GEIv~ . . . / / / / / / / / / / / / / / /  / 0 0%% V^$$$%%%%%%%%%%%%%%%%%%s0** %BB B 6 C##C'*C'target_soft_limitcltjdrtddSddl}|j}||\}}||krO ||||fdS#t$r'}t d||Yd}~dSd}~wwxYwdS)Nwinz-Windows detected, skipping ulimit adjustment.rzFound ulimit of %s and failed to automatically increase with error %s. This can cause fd limit errors like `OSError: [Errno 24] Too many open files`. Consider increasing with ulimit -n) r)platform startswithrinforesource RLIMIT_NOFILE getrlimit setrlimit ValueErrorr)rr resource_type current_soft current_hardes r set_ulimitrs |u%% CDDDOOO*M!)!3!3M!B!BL,'''    }/@,.O P P P P P    NN,           ('s&B B1 B,,B1lib_namecd}td5}|D] }||vr|}n dddn #1swxYwY|dS|d}||d}|dd}|dd|sJd|d||S) a) According to according to https://man7.org/linux/man-pages/man5/proc_pid_maps.5.html, the file `/proc/self/maps` contains the memory maps of the process, which includes the shared libraries loaded by the process. We can use this file to find the path of the a loaded library. Nz/proc/self/maps/rcz.sorzUnexpected filename: z for library )r-indexstripsplit rpartitionr)r found_lineflinestartpathfilenames rfind_loaded_libraryrs8J  A  D4!   t   S ! !E eff  # # % %Dzz#r"H   u % %a ( 3 3H = =AAAxAA = Ks ,00)rr)rrrrrr)r7r8rr)rOrrPrrQrrrR)rXrrYrrZr[rrR)N)rprqrrR)rZr[)r)rr[)rrrrq), __future__rr~rJrrr)collections.abcrrpathlibrtypingrrz vllm.envsr' vllm.loggerrvllm.platforms.interfacer vllm.ray.lazy_utilsr platform_utilsr r __name__rrlrmrcontextmanagerr$r6r=rHrMVLLM_PROCESS_NAME_PREFIXrWrorwrrrrrrs1#""""" ........ ######++++++//////CCCCCCCC X        " " " " F    $"="="=J 2 2 2/33333"####: / / / / /%%%%:0r