&`i9 ddlZddlZddlZddlmZmZddlZddlZdZej j j Z dddeide j de jid d d id d id ddddddddgdddddgdddddgdddddgddddZdd iZd!Zd"Ziadaejejdz d#Gd$d%ZGd&d'ejZd(eefd)Zd(eefd*Zd?d+Zd,efd-Zd.ed(efd/Z d.ed(efd0Z!d.ed1ed2ed(efd3Z"d.ed4ed(dfd5Z#d?d6Z$d?d7Z%d(eefd8Z&d(ej'fd9Z(d:ed(efd;Z)d:eed(dfd<Z*d:ed(ee+fd=Z,d:ed(ee+fd>Z-dS)@N)ListOptionalz@%(asctime)s %(levelname)s %(filename)s:%(lineno)s -- %(message)sFformatclass.)rayray_json()z-ray.data._internal.logging.HiddenRecordFilterz%ray._common.filters.CoreContextFilter)console_filtercore_context_filterz-ray.data._internal.logging.SessionFileHandlerr z ray-data.log)r formatterfilenamer r )rrrfiltersz ray._private.log.PlainRayHandlerINFOr )rrlevelr)file file_jsonconsoleDEBUGrr)rhandlers propagate)ray.datazray.air.util.tensor_extensions)versiondisable_existing_loggers formattersrrloggersrRAY_DATA_LOG_ENCODINGRAY_DATA_LOGGING_CONFIGTRACEceZdZdZdZdS)HiddenRecordFilteraFilters out log records with the "hide" attribute set to True. This filter allows you to override default logging behavior. For example, if errors are printed by default, and you don't want to print a specific error, you can set the "hide" attribute to avoid printing the message. .. testcode:: import logging logger = logging.getLogger("ray.data.spam") # This warning won't be printed to the console. logger.warning("ham", extra={"hide": True}) c&t|dd S)NhideF)getattrselfrecords n/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/data/_internal/logging.pyfilterzHiddenRecordFilter.filterds6651111N)__name__ __module__ __qualname____doc__r*r+r)r"r"Ts-  22222r+r"cNeZdZdZdeffd ZdZdejddfdZ d Z xZ S) SessionFileHandleralA handler that writes to a log file in the Ray session directory. The Ray session directory isn't available until Ray is initialized, so this handler lazily creates the file handler when you emit a log record. Args: filename: The name of the log file. The file is created in the 'logs' directory of the Ray session directory. rct||_d|_d|_d|_dSN)super__init__ _filename_handler _formatter_path)r'r __class__s r)r6zSessionFileHandler.__init__ss9 !  r+c|j||j|j|dSdSr4)r8_try_create_handleremitr&s r)r>zSessionFileHandler.emitzsH =  $ $ & & & = $ M  v & & & & & % $r+fmtreturnNcV|j|j|||_dSr4)r8 setFormatterr9)r'r?s r)rBzSessionFileHandler.setFormatters+ = $ M & &s + + +r+cH|jJt}|dStj|dtj||j|_tj |j|_|j !|j |j dSdS)NT)exist_ok) r8get_log_directoryosmakedirspathjoinr7r:logging FileHandlerr9rB)r' log_directorys r)r=z&SessionFileHandler._try_create_handlers}$$$)++  F MD1111W\\-@@ +DJ77 ? & M & &t 7 7 7 7 7 ' &r+) r,r-r.r/strr6r>rJ FormatterrBr= __classcell__)r;s@r)r2r2hs'''  1d 8 8 8 8 8 8 8r+r2r@cdtfd}tjt}tjt }| ||}nt }||dkrr|dD]W}t D];\}}|d ||d |._load_logging_configsv +   *$^D))F * * * * * * * * * * * * * * * s 155JSONrr) rMrFenvironget$RAY_DATA_LOGGING_CONFIG_ENV_VAR_NAME"RAY_DATA_LOG_ENCODING_ENV_VAR_NAMEDEFAULT_CONFIGuppervalues'RAY_DATA_LOG_HANDLER_JSON_SUBSTITUTIONSitemsremoveappend)rWrQ log_encodingrVloggerold_handler_namenew_handler_names r)_get_logging_configrhs# *..!EFFK:>>"DEEL%%k22  # (:(:(<(<(F(F +2244 @ @=BBDD@@$$:&--.>???:&--.>???? @ Mr+ctdi}t|S)Nr)rhrZlistkeys) logger_configs r)_get_logger_namesrms7'))--i<>@@GGj j +Jw,?@@O.00Jt    # #&0H1EFFJt  r+ci}|diD]+\}}d|vr"t|d}|||<,|S)z$Create filter instances from config.rr )rZrar~)rVrr filter_config filter_classs r)rprpsgG%zz)R88>>@@++m = (t)<==L(LNNGDM Nr+rrc6 i}hd |diD]\}}t|d} fd|D}|di|}||_d|vr||dd|vr2||d} | r|| |dgD].} || } | r|| /|||<|S) z3Create and configure handler instances from config.>rrrrrrc$i|] \}}|v || Sr0r0).0kvHANDLER_CONFIG_KEYSs r) z$_create_handlers..s1   Qq@S7S7SAq7S7S7Sr+rrrr0)rZrar~rsetLevelrB addFilter) rVrrrrhandler_config handler_classhandler_kwargshandlerr filter_name filter_objrs @r)rqrqsiHEDD & :r : : @ @ B B!!n%nW&=>>     +1133    -11.11  n $ $   ^G4 5 5 5 . ( ("~k'BCCI 0$$Y///)--i<< . .K [11J .!!*---  Or+rc|diD]\}}tj|}||dtj|jddD]}|||dgD].}||}|r||/|dd|_ dS)z'Configure logger instances from config.rrNrrT) rZrarJ getLoggerrNOTSETr removeHandler addHandlerr)rVr logger_namerlrer handler_names r)rrrrs&,jjB&?&?&E&E&G&G@@" ]";// ))'7>BBCCCqqq) * *G   ) ) ) )*--j"== + +Lll<00G +!!'***(,,[$??@@r+ctjt}tjt}|2|2t jt}|ddSdSdS)zGWarn if both RAY_DATA_LOGGING_CONFIG and RAY_DATA_LOG_ENCODING are set.NzMUsing `RAY_DATA_LOG_ENCODING` is not supported with `RAY_DATA_LOGGING_CONFIG`) rFrYrZr[r\rJrr,warning)rQrdres r)rsrs)sz*..!EFFK:>>"DEEL<#;"8,, *     #;#;r+ctjd}|j|tjiadadS)zSReset the logger named 'ray.data' to its initial state. Used for testing. rN)rJrrclearrr_DATASET_LOGGER_HANDLER_ACTIVE_DATASET)res r) reset_loggingr8sK z * *F O OOGN### OOOr+ctjjj}|dS|}t j|ddS)zyReturn the directory where Ray Data writes log files. If Ray isn't initialized, this function returns ``None``. Nlogszray-data)r _privateworker _global_nodeget_session_dir_pathrFrHrI) global_node session_dirs r)rErEGsE ,%2Kt2244K 7<< VZ 8 88r+ctjt}|&|dkrt St jtS)NrX) rFrYrZr\r^DEFAULT_JSON_FORMATTERrJrNDEFAULT_TEXT_FORMATTER)rds r)_get_default_formatterrTsP:>>"DEELL$6$6$8$8F$B$B%'''  3 4 44r+ dataset_idcptd|d}|t|S)zCreate a log handler for a dataset with the given ID. Args: dataset_id: The ID of the dataset. Returns: A log handler for the dataset. z ray-data-z.log)r)r2rBr)rrs r)_create_dataset_log_handlerr\s@!*Fj*F*F*FGGGG /11222 Nr+c|sdStt|}dtD}|D]}||dS)a<Create a log handler for a dataset with the given ID. Switch the dataset logger for the worker to this dataset logger. Note that only the driver keeps track of the active dataset. The worker will just use the handler that the driver tells it to use. Args: dataset_id: The ID of the dataset. Nc6g|]}tj|Sr0rJrrrs r) z4update_dataset_logger_for_worker..w#GGG4w &&GGGr+)rtrrmr)r log_handlerrres r) update_dataset_logger_for_workerrkst -j99KGG3D3F3FGGGG''+&&&&''r+cdtD}t|}tjt}|||d||t|<ts|a|D]}||n#||dtd|d| |tS)aCreate a log handler for a dataset with the given ID. Activate the handler if this is the only active dataset. Otherwise, print a warning to that handler and keep it inactive until it becomes the only active dataset. Args: dataset_id: The ID of the dataset. c6g|]}tj|Sr0rrs r)rz+register_dataset_logger..rr+z(Registered dataset logger for dataset %sz- registers for logging while another dataset zJ is also logging. For performance reasons, we will not log to the dataset z% until it is the only active dataset.) rmrrJrr,rinforrr)rrr local_loggerres r)register_dataset_loggerr|sHG3D3F3FGGGG-j99K$X..LK(((@*MMM*5J'   $ + +F   k * * * * +  T T T T", T T T   {+++ r+c~dtD}t|d}t|krIdatr@t t t t|r.|D]}||| tS)zmRemove the logger for a dataset with the given ID. Args: dataset_id: The ID of the dataset. c6g|]}tj|Sr0rrs r)rz-unregister_dataset_logger..rr+N) rmrpoprrnextiterrkrclose)rrrres r)unregister_dataset_loggerrsHG3D3F3FGGGG)--j$??K*$$ " P #D.E.J.J.L.L)M)M$N$N O O O . .F   - - - - r+)r@N).rJlogging.configrFtypingrrrTr r_commonr JSONFormatterrr-r,r]r`r\r[rr addLevelNamerr"Handlerr2dictrhrMrmrtr~rorprqrrrsrrErNrrrintrrr0r+r)rs !!!!!!!! H/= %01 .9]]