&`i6 nddlZddlZddlZddlZddlZddlmZddlm Z ddl Z ddl m cm cmcmZddlm cm cmcmZddlm cmZddlm cmZddlmZddlmZmZejeZej Z!dZ"dZ#edd Z$ d d ej%d e&d e'de'fdZ(d ej%de'fdZ)d ej%d e'de'de'fdZ*e"fd ej%de'de'de'de'f dZ+dde"fde j,j-d ej%d e'de'de'de'f dZ.Gddej/Z0ej12e$Z3Gddej/Z4dS)!N)Path)Optional) env_integer) reporter_pb2reporter_pb2_grpci2RAY_DASHBOARD_LOG_TASK_LOG_SEARCH_MAX_WORKER_COUNT)defaultfilecontent start_offsetreturnc.td|d||tj|} |t }|dkrdS||}|dkr||zS|t|z }U)aFind the offset of the first occurrence of content in a file. Args: file: File object content: Content to find start_offset: Start offset to read from, inclusive. Returns: Offset of the first occurrence of content in a file. zFinding offset of content z in fileT) loggerdebugseekioSEEK_SETread BLOCK_SIZEfindlen)r r roffset block_data block_offsets w/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/dashboard/modules/log/log_agent.pyfind_offset_of_content_in_filer s LL?g???@@@IIlBK((( F "YYz**   2!w// 2  L( (#j//! "rc|}|dtj|}||tj|S)z Find the offset of the end of a file without changing the file pointer. Args: file: File object Returns: Offset of the end of a file. r)tellrrSEEK_ENDr)r old_posends rfind_end_offset_filer&?sOiikkGIIa ))++CIIgr{### Jrnc6||d}t|D].}|}|sn|}/td|d|d||n|dt jS)a  Find the offsets of next n lines from a start offset. Args: file: File object start_offset: Start offset to read from, inclusive. n: Number of lines to find. Returns: Offset of the end of the next n line (exclusive) Nz Found next lines from  offsetr)rrangereadliner"rrrr#)r rr' end_offset_lines r(find_end_offset_next_n_lines_from_offsetr0Ps IIlJ 1XX!!}}  EYY[[  LLCqCClCCCDDD , $))Ar{2K2Krr block_sizectd|d|d|dkr!|dtj}n ||tj|dkr|Sd}|t d|dz tj|ddkr|dz}|}t d||z }|}|dkr|dkr||d|t|||z }| d} | |kr2| d| |z } |t| dz }n?|| z}|t|z }|dkrn!|}t d||z }|dkr|dk||z } | dksJd| d | S) a Find the offset of the beginning of the line of the last X lines from an offset. Args: file: File object offset: Start offset from which to find last X lines, -1 means end of file. The offset is exclusive, i.e. data at the offset is not included in the result. n: Number of lines to find block_size: Block size to read from file Returns: Offset of the beginning of the line of the last X lines from a start offset. z Finding last r)r*rrr zRead start offset(z) should be non-negative) rrrrr#rmaxosrmincountsplitr) r rr'r1nbytes_from_end lines_more read_offset prev_offsetr num_lineslinesoffset_read_starts r*find_start_offset_last_n_lines_from_offsetr@ls" LL??????@@@ ||1bk** &"+&&&Avv    IIc!VaZ  "+... yy||u QJa*,--KK //kQ.. +q!!!YYs:{[/HIIJJ $$U++ z ! ! $$UI ,BCCE s59~~ -O  i 3z??* !   ! ![:566 5 //kQ..80QG-GGG  rrcontextr-keep_alive_interval_secc^Kd|jvs Jd|dkr|dkr Jd||d|}|s|dkrt||z |}n|}||}|dkr#|dkrt j|d{VldStdt|d |tj | WV|t|z }|dkr||krdS|dSdS) a}Streaming log in chunk from start to end offset. Stream binary file content in chunks from start offset to an end offset if provided, else to the end of the file. Args: context: gRPC server side context file: Binary file to stream start_offset: File offset where streaming starts end_offset: If -1, implying streaming til the EOF. keep_alive_interval_sec: Duration for which streaming will be retried when reaching the file end, -1 means no retry. block_size: Number of bytes per chunk, exposed for testing Return: Async generator of StreamReply bzOnly binary file is supported.rrz7Keep-alive is not allowed when specifying an end offsetrNzSending z bytes at )data) moderdoner6rasynciosleeprrrrStreamLogReply) rAr rr-rBr1 cur_offsetto_readbytess r_stream_log_in_chunkrNs2 $)   =   1$$r)9)9)9@*:)9  IIlAJllnn   *z1:>>GG G '"" C<<&!++m$;<<<<<<<<< E BE BBjBBCCC)u5555555 c%jj    j 8 8 E1llnnrc:eZdZfdZdZedZxZS)LogAgentct|tjtd|jjddS)Nz/logsT) show_index)super__init__ log_utilsregister_mimetypesroutesstatic_dashboard_agentlog_dirselfdashboard_agent __class__s rrTzLogAgent.__init__sN )))$&&& gt4< NNNNNrc KdSNr\servers rrunz LogAgent.runs  rcdSNFrararris_minimal_modulezLogAgent.is_minimal_modulesur)__name__ __module__ __qualname__rTrd staticmethodrg __classcell__r^s@rrPrPsgOOOOO    \rrP) max_workersceZdZfdZdZedeefdZe dZ dZ e de dede fd Zd ZxZS) LogAgentV1GrpccJt|dSr`)rSrTr[s rrTzLogAgentV1Grpc.__init__s! )))))rc<K|rtj||dSdSr`)r add_LogServiceServicer_to_serverrbs rrdzLogAgentV1Grpc.run s4  M  >tV L L L L L M Mrrc4|jSr`)rY get_node_id)r\s rnode_idzLogAgentV1Grpc.node_ids$00222rcdSrfrararrrgz LogAgentV1Grpc.is_minimal_modules urcKt|jj}|st d|jjdg}||jD]P}|t| || rdndzQtj |S)z Lists all files in the active Ray logs directory. Part of `LogService` gRPC. NOTE: These RPCs are used by state_head.py, not log_head.py z Could not find log dir at path: z7It is unexpected. Please report an issue to Ray Github./) log_files) rrYrZexistsFileNotFoundErrorglob glob_filterappendstr relative_tois_dirr ListLogsReply)r\requestrApathr{ps rListLogszLogAgentV1Grpc.ListLogssD)122{{}} #J43H3PJJJ  7.// U UA   St!4!455 9RPRS T T T T)I>>>>r root_log_dirfilenamect|s||z }nt|}ttj|}|st d| ||n)#t$r}t |d|d|d}~wwxYw| S)au Resolves the file path relative to the root log directory. Args: root_log_dir: Root log directory. filename: File path relative to the root log directory. Raises: FileNotFoundError: If the file path is invalid. Returns: The absolute file path resolved from the root log directory. zA file is not found at: z not in z: N) r is_absoluter5rabspathis_filer}r ValueErrorresolve)clsrrfilepathes r_resolve_filenamez LogAgentV1Grpc._resolve_filename+sH~~))++ &#h.HHH~~H 1122!! K#$Ix$I$IJJ J N   . . . . N N N#x$L$L$L$L$L$LMM M N!!!s B C*CCc bK|jr|jnd} |t|jj|j}t |d5}|gd{V|dr|j nd}|dr|j nt|}|dkr tt||||}d}|jr|jr|jnt }d}t"d |d |d |d |t'||||| 23d{V} | WV 6 ddddS#1swxYwYdS#t($r@} |t*jt/| ggd{VYd} ~ dSd} ~ wwxYw)af Streams the log in real time starting from `request.lines` number of lines from the end of the file if `request.keep_alive == True`. Else, it terminates the stream once there are no more bytes to read from the log file. Part of `LogService` gRPC. NOTE: These RPCs are used by state_head.py, not log_head.py irbNrrr-r)rr'zTailing logs from z to z for lines=z, with keep_alive=)rAr rr-rB)r>rrrYrZ log_file_nameopensend_initial_metadataHasFieldrr-r&r4r@ keep_aliveintervalDEFAULT_KEEP_ALIVE_INTERVAL_SECrinforNr} log_constsLOG_GRPC_ERRORr) r\rrAr>rfrr-rB chunk_resrs r StreamLogzLogAgentV1Grpc.StreamLogOs")8 D7 $--T*233W5JH h%%0 $33B777777777-4,<,<^,L,LSG((RS '' 551G&&-a00 B;;$'BjE% $$L+-'%$#+=((<,"$J PPP:PP"PP6MPP (<#!-),C ((($$$$$$$)$OOOOO((S0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $0 $! W W W//*2KSQRVV1T0UVV V V V V V V V V V V V V V Ws62E$C%E;EEEE$ F..5F))F.)rhrirjrTrdpropertyrrrvrkrgr classmethodrrrrlrms@rrprps*****MMM3#333X3\???&!"T!"S!"T!"!"!"[!"FE$E$E$E$E$E$E$rrp)r)5rHconcurrent.futures concurrentrloggingr5pathlibrtypingrgrpc$ray.dashboard.modules.log.log_consts dashboardmoduleslogr#ray.dashboard.modules.log.log_utilsrUray.dashboard.optional_utilsoptional_utilsdashboard_optional_utilsray.dashboard.utilsutilsdashboard_utilsray._private.ray_constantsrray.core.generatedrr getLoggerrhrDashboardAgentRouteTablerWrrr BufferedIOBaserMintr r&r0r@aioServicerContextrNDashboardAgentModulerPfuturesThreadPoolExecutor_task_log_search_worker_poolrprarrrsM   999999999999999777777777777777?????????---------222222>>>>>>>>  8 $ $ ! : #$5@[8!6662 BC"" "&+";>""""">r0S" +.36:EOHH H%(H-0H>AHHHHH^#% :: X %: :: : ! :  ::::z     3    *1DDB E   M$M$M$M$M$_9M$M$M$M$M$r