PitddlZddlmZmZddlmZddlmZmZm Z ddl m Z eGddZ dS) N) dataclassfield)Path)AnyOptionalUnion)configceZdZUdZdZeeeefe d<dZ e e d<dZ e e d<dZ e e d<dZeee d<dZeee d <dZe e d <dZe e d <dZe e d <dZe e d <dZe e d<dZeee d<dZee d<dZeeee fe d<eeZeeefe d<dZeee d<dZe e d<ddZfdZ xZ!S)DownloadConfiga\ Configuration for our cached path manager. Attributes: cache_dir (`str` or `Path`, *optional*): Specify a cache directory to save the file to (overwrite the default cache dir). force_download (`bool`, defaults to `False`): If `True`, re-download the file even if it's already cached in the cache dir. resume_download (`bool`, defaults to `False`): If `True`, resume the download if an incompletely received file is found. proxies (`dict`, *optional*): user_agent (`str`, *optional*): Optional string or dict that will be appended to the user-agent on remote requests. extract_compressed_file (`bool`, defaults to `False`): If `True` and the path point to a zip or tar file, extract the compressed file in a folder along the archive. force_extract (`bool`, defaults to `False`): If `True` when `extract_compressed_file` is `True` and the archive was already extracted, re-extract the archive and override the folder where it was extracted. delete_extracted (`bool`, defaults to `False`): Whether to delete (or keep) the extracted files. extract_on_the_fly (`bool`, defaults to `False`): If `True`, extract compressed files while they are being read. use_etag (`bool`, defaults to `True`): Whether to use the ETag HTTP response header to validate the cached files. num_proc (`int`, *optional*): The number of processes to launch to download the files in parallel. max_retries (`int`, default to `1`): The number of times to retry an HTTP request if it fails. token (`str` or `bool`, *optional*): Optional string or boolean to use as Bearer token for remote files on the Datasets Hub. If `True`, or not specified, will get token from `~/.huggingface`. storage_options (`dict`, *optional*): Key/value pairs to be passed on to the dataset file-system backend, if any. download_desc (`str`, *optional*): A description to be displayed alongside with the progress bar while downloading the files. disable_tqdm (`bool`, defaults to `False`): Whether to disable the individual files download progress bar N cache_dirFforce_downloadresume_downloadlocal_files_onlyproxies user_agentextract_compressed_file force_extractdelete_extractedextract_on_the_flyTuse_etagnum_proc max_retriestoken)default_factorystorage_options download_desc disable_tqdmreturnc^|jdid|jDS)Nc>i|]\}}|tj|S)copydeepcopy).0kvs u/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/datasets/download/download_config.py z'DownloadConfig.copy..Is( W W WADM!$4$4 W W Wr#) __class____dict__items)selfs r)r$zDownloadConfig.copyHs7t~XX W WATATAVAV W W WXXXr+c|dkr^t|ddMd|jvrtj|d|jd<n,t|jddd||jdd<t ||dS)Nrrhf)endpointr)getattrrr HF_ENDPOINTsuper __setattr__)r/namevaluer,s r)r6zDownloadConfig.__setattr__Ks 7??wt->EEQ4///:@:LW\-]-]$T**-d3WdCCK6;$T*73 D%(((((r+)r r )"__name__ __module__ __qualname____doc__r rrstrr__annotations__rboolrrrdictrrrrrrrintrrrrrrrr$r6 __classcell__)r,s@r)r r s))V-1Ixc4i()000 ND   !OT!!!"d""""GXd^""" $J $$$$)T)))M4"d"""$$$$Hd"Hhsm"""K(,E8E#t)$ %,,,&+eD&A&A&AOT#s(^AAA#'M8C='''L$YYYY)))))))))r+r ) r$ dataclassesrrpathlibrtypingrrrr r r#r+r)rGs (((((((('''''''''' G)G)G)G)G)G)G) G)G)G)r+