&`i_0 ddlZddlZddlZddlZddlZddlZddlmZddlmZm Z m Z m Z m Z m Z mZddlmZddlmZmZddlmZmZmZmZddlmZmZmZddlmZ ddlZdd l m!Z!m"Z"n#e#$r dZdZ!dZ"YnwxYwej$e%Z&d Z'd Z(d ed e e)fdZ*de e)efd e e)effdZ+de)d e)fdZ,de)d e e e e)fdZ-de!ded eee"ffdZ. d$d ede e)de e/d e e e)efe e)efffdZ0d edede)d e efdZ1d edede e)d e e)effdZ2 d%de)d e/d!e/d"e/d e)f d#Z3dS)&N) dataclass)Any AsyncIteratorDictListOptionalTupleUnion) ray_constants)RAY_INTERNAL_NAMESPACE_PREFIX GcsClient)JOB_ID_METADATA_KEYJobInfoStorageClient JobStatusvalidate_request_type) DriverInfo JobDetailsJobType) RuntimeEnv)RequestResponse i N gcs_clientreturncK|tjtjdd{V}|dS|S)z%Fetches Head node id persisted in GCS) namespacetimeoutN)async_internal_kv_getr KV_HEAD_NODE_ID_KEYKV_NAMESPACE_JOBdecode)rhead_node_id_hex_bytess s/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/dashboard/modules/job/utils.pyget_head_node_idr%%sn#-#C#C)0$D$$ %t ! ( ( * **dc>d|DS)z-Strip keys with value None from a dictionary.ci|] \}}||| SN).0kvs r$ z.strip_keys_with_value_none..3s 8 8 8TQ!-Aq---r&)items)r's r$strip_keys_with_value_noner11s 8 8QWWYY 8 8 88r&urlctjd|}t|dkr |d|ddd}|S)zRedact any passwords in a URL.zhttps?:\/\/.*:(.*)@.*r:@z :@)refindalllenreplace)r2secrets r$redact_url_passwordr;6sK Z0# 6 6F 6{{Qkk*fQi***N;; Jr&pathcKt|ts tdt|dtj|sBtd|ddWVtj|Bd}t|d5}g}d}d} t|d ks|tks||kr |pdWVg}d}| }||kr(| ||t|z }ntjd d{V#1swxYwYdS) awYield lines from a file as it's written. Returns lines in batches of up to 10 lines or 20000 characters, whichever comes first. If it's a chunk of 20000 characters, then the last line that is yielded could be an incomplete line. New line characters are kept in the line string. Returns None until the file exists or if no new line has been written. zpath must be a string, got .zPath z doesn't exist yet.NrrTr) isinstancestr TypeErrortypeosr<existsloggerdebugopenr8MAX_CHUNK_CHAR_LENGTHreadlineappendasynciosleep)r<EOFflineschunk_char_count curr_lines r$file_tail_iteratorrU?s dC ECd4jjCCCDDDgnnT"" 6T666777 gnnT"" C dC#'A  ' E b  #&;;;##mt#####$  I C Y''' C NN2  mA&&&&&&&&&; ' #'#'#'#'#'#'#'#'#'#'s+BD??EEreq request_typecHKddl}t|d{V} t||S#t$rX}t d|ttj |j j j cYd}~Sd}~wwxYw)aParse request and cast to request type. Remove keys with value None to allow newer client versions with new optional fields to work with older servers. If parsing failed, return a Response object with status 400 and stacktrace instead. Args: req: aiohttp request object. request_type: dataclass type to cast request to. Returns: Parsed request object or Response object with status 400 and stacktrace. rNzGot invalid request type: )textstatus) aiohttpr1jsonr ExceptionrHinfor traceback format_excwebHTTPBadRequest status_code)rVrWr[ json_dataes r$parse_and_validate_requestrfxs"NNN*+;+;+;+;+;+;<z!get_driver_jobs..s8N8R8R8T8Tr&)key)idnode_ip_addresspid) rlrErZ entrypoint start_timeend_timemetadata runtime_env driver_info)!async_get_all_job_infosortedvaluesconfig ray_namespace startswithr rlrmdictrwgetrrdriver_address ip_addressrC driver_pidrrDRIVERis_deadr SUCCEEDEDRUNNINGrtrurvr deserializeruntime_env_infoserialized_runtime_envto_dict) rrgr job_infossorted_job_infosjobssubmission_job_driversrnrlrwjob_submission_iddriverjobs r$get_driver_jobsrs!771'+$( 8I T T D+%?%?  ! / : : )     '++--.788$LL)<==  ? / > I233F ^"*'y**&*5*5(1!&2#*;R'))"CDLL / > I233F 9? "#4 5 5 ' ''r&job_info_clientc Kt|d{V\}}|}|r|Stfd|Dd}|s}||d{V}|rO||}t dit j|||r|jnd|tj d}|SdS)zH Attempts to find the job with a given submission_id or job id. )rgNc38K|]\}}|jk|VdSr*rq)r,rqrrgs r$ z"find_job_by_ids..sA  Fy000 0000  r& submission_idrlryrEr+) rrnextr0get_infor dataclassesasdictrqr SUBMISSION) rrrg driver_jobsrrrjob_infors ` r$find_job_by_idsrs\1@)=111++++++'K' //. / /C      4::<<   M -- $--m<<<<<<<.s$RRRS3'>>3>>>r&c.i|]\}}|jv||Sr+rrs r$r/z(find_jobs_by_job_ids..s2S#36WCTCTSCTCTCTr&c:g|]}|Sr+)r)r,rrs r$ z(find_jobs_by_job_ids..s7     $ $] 3 3   r&c i|]x\}}|jtditj|||j|t jdyS)rr+)rrqrrrrr)r,rrrs r$r/z(find_jobs_by_job_ids..'s (- # & &} 5 5 8*;;$X..;+-11-@@C266}EE' ;;;; r&)rr0keysrNgatherzip)rrrrjob_submission_idsrrs `` @r$find_jobs_by_job_idsr s<1@ 0K0K*K*K*K*K*K*K'K'SRRRK,=,=,?,?RRRK!7!=!=!?!? 04466n    !3   I    ,/y:L+M+M   r& num_lines max_chars block_sizec $|dkrtd||dkrdS|dkrtd||dkrdS|dkrtd|td|d|d|d |t|d 5}|dt j|}|dkr d d d dSg}|}d}|dkr||d zkr|t||} || z}||| | } || d z }| d| |dkr ||d zk|d d d n #1swxYwYd |} | ddd} t| |krd | } nd | | d } | | d S)aReturn the last ``num_lines`` lines from a large log file efficiently. This function avoids scanning the entire file. It seeks to the end of the file and reads backwards in fixed-size blocks until enough lines are collected. This is much faster for large files compared to using ``file_tail_iterator()``, which performs a full sequential scan. Args: path: The file path to read. num_lines: Number of lines to return. max_chars: Maximum number of characters in the returned string. block_size: Read size for each backward block. Returns: A string containing at most ``num_lines`` of the last lines in the file, truncated to ``max_chars`` characters. rz$num_lines must be non-negative, got r?z$max_chars must be non-negative, got z!block_size must be positive, got zStart reading log file z with num_lines=z max_chars=z block_size=rbNrA r&zutf-8r9)errorsT)keepends) ValueErrorrHrIrJseekrFSEEK_ENDtellminreadcountinsertjoinr" splitlinesr8)r<rrrrQ file_sizechunkspositionnewlines_found read_sizechunkbufferrRresults r$fast_tail_last_n_linesr4s.1}}K KKLLLA~~r1}}K KKLLLA~~rQIZIIJJJ LLq$qq qqiqqeoqq dD  $Q q"+FFHH >> $$$$$$$$ ll~ A ==J11I  !H FF8   FF9%%E ekk%00 0N MM!U # # #ll~ A ==$$$$$$$$$$$$$$$*XXf  F MM')M 4 4 ? ? ? N NE 5zzY z{{+,, 9*++ srs !!!!!!IIIIIIIIIIIIIIIIII&&&&&&@@@@@@@@ VUUUUUUUUU&&&&&&NNN---------GGHHH  8 $ $ +y +Xc] + + + +9$sCx.9T#s(^9999 SS6'36'=$s)9L+M6'6'6'6'r  )  9h     @+/!D(D(D("3-D(c]D( 4Z $sJ"7 78 D(D(D(D(N**)**j ****Z'')'#Y' #z/ ''''\ BB BBB B  BBBBBBs A)) A76A7