Pi ddlZddlZddlmZddlmZddlmZddlm Z m Z ddl m Z ddl mZmZddlmZdd lmZejeZgd Ze jd e jd e jd iZe jhde jddhe jhdiZd(dddededzdedzdefdZ d)dededede eezdzddf dZ!ddddddde dededededzd ed!e dzd"edefd#Z"dddd$de dededededzd edefd%Z#de d&eddfd'Z$dS)*N)Any) ApiBlobType)registry)KaggleDatasetAdapterPolarsFrameType)create_dataset_or_version)normalize_patternsupload_files_and_directories)parse_dataset_handle)EXTRA_CONSOLE_BLOCK)z.git/z*/.git/z.cache/z .huggingface/z hf-datasetszpandas-datasetszpolars-datasets> hf_kwargs sql_query pandas_kwargsrr>r polars_kwargspolars_frame_typeFforce_downloadhandlepathrreturnct|}td|ditt j|||\}}|S)aADownload dataset files Args: handle: (string) the dataset handle path: (string) Optional path to a file within a dataset force_download: (bool) Optional flag to force download a dataset, even if it's cached Returns: A string requesting the path to the requested dataset files. zDownloading Dataset:  ...)extrar)r loggerinfoto_urlr rdataset_resolver)rrrh_s f/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/kagglehub/datasets.pydataset_downloadr!"sb V$$A KK8 888@WCV@WKXXX'4OOOGD! Klocal_dataset_dir version_notesignore_patternscPt|}td|d|rd}t |t |tjtt|}t|||dS)aUpload dataset files. Args: handle: (string) the dataset handle. local_dataset_dir: (string) path to a file in a local directory. version_notes: (string) Optional to write dataset versions. ignore_patterns (str or list[str], optional): Additional ignore patterns to DEFAULT_IGNORE_PATTERNS. Files matching any of the patterns are not uploaded. Patterns are standard wildcards that can be matched by https://docs.python.org/3/library/fnmatch.html. Use a pattern ending with "/" to ignore the whole dir, e.g., ".git/" is equivalent to ".git/*". zUploading Dataset rz1The dataset handle should not include the version)default additional) item_typer&N) r rrr is_versioned ValueErrorr rDATASETr DEFAULT_IGNORE_PATTERNSr)rr$r%r&ris_versioned_exceptiontokenss r dataset_uploadr11s& V$$A KK5QXXZZ555666~~1!T/000 )%*3JWfgggF a77777r"rrr rradapterr rrct||||||||n tj} |tjur#ddl}|j|||||S|tjur"ddl }|j ||||S|tj ur#ddl }|j|||||S|d} t!| #t"$r't$|} d| d | d } t#| dwxYw) aLoad a Kaggle Dataset into a python object based on the selected adapter Args: adapter: (KaggleDatasetAdapter) The adapter used to load the dataset handle: (string) The dataset handle path: (string) Path to a file within the dataset pandas_kwargs: (dict) Optional set of kwargs to pass to the pandas `read_*` method while constructing the DataFrame(s) sql_query: (string) Argument to be used for SQLite files. Required when reading a SQLite file. See pandas documentation for details: https://pandas.pydata.org/docs/reference/api/pandas.read_sql_query.html hf_kwargs: (dict) Optional set of kwargs to pass to Dataset.from_pandas() while constructing the Dataset polars_frame_type: (PolarsFrameType) Optional control for which Frame to return: LazyFrame or DataFrame. The default is PolarsFrameType.LAZY_FRAME. polars_kwargs: (dict) Optional set of kwargs to pass to the polars `read_*` method while constructing the DataFrame(s) Returns: A python object based on the selected adapter: - 'pandas': A DataFrame (or dict[int | str, DataFrame] for Excel-like files with multiple sheets) - 'hugging_face': A Huggingface Dataset (via pandas) - 'polars': A LazyFrame or DataFrame (or dict[int | str, LazyFrame] / dict[int | str, DataFrame] for Excel-like files with multiple sheets) r2Nrrrr )rr)rrrz is not yet implementedz*The 'dataset_load' function requires the 'z3' extras. Install them with 'pip install kagglehub[z]')validate_dataset_load_argsr LAZY_FRAMEr HUGGING_FACEkagglehub.hf_datasets hf_datasetsload_hf_datasetPANDASkagglehub.pandas_datasetspandas_datasetsload_pandas_datasetPOLARSkagglehub.polars_datasetspolars_datasetsload_polars_datasetNotImplementedError ImportError.DATASET_LOAD_ADAPTER_OPTIONAL_DEPENDENCIES_MAP) r3rrrrr rr kagglehubnot_implemented_error_messageadapter_optional_dependencyimport_warning_messages r dataset_loadrKSsJ#+# .?-J))P_Pj!< *7 7 7 ( ( ( ((88+## 9 ,3 3 3 , , , ,,@@MYA ,3 3 3 , , , ,,@@0AQ^jsA 07,O,O,O )%&CDD D <<<&TU\&]# X9T X X8S X X X  011t;r5cdtjdtdt||||||S)NzaUse dataset_load() instead of load_dataset(). load_dataset() will be removed in a future version.) stacklevelr5)warningswarnDeprecationWarningrK)r3rrrrr s r load_datasetrRsE Mk ]V_kt u u uur"kwargsc "t|}g}|D] \}}||vr|||!t|dkrdSd|}t |d|ddS)Nrz, z are invalid for z and will be ignored)_DATASET_LOAD_VALID_KWARGS_MAPitemsappendlenjoinrwarning)r3rS valid_kwargsinvalid_kwargs_listkeyvalueinvalid_kwargss r r6r6s2':L%'llnn,, U l " "u'8  & &s + + + 1$$YY233N NNnTTwTTTUUUUUr")N)r#N)%loggingrOtypingr&kagglesdk.blobs.types.blob_api_servicerrGrkagglehub.datasets_enumsrrkagglehub.datasets_helpersrkagglehub.gcs_uploadr r kagglehub.handler kagglehub.loggerr getLogger__name__rr.r8r<r@rFrUstrboolr!listr1rKrRr6r"r rns5>>>>>>JJJJJJJJ@@@@@@QQQQQQQQ111111000000  8 $ $KJJ%}!2!22.%'R'R'R/;!?!T!T!T" \a   S d dUYk fi    $.2 88 888#Y_t+ 8  8888P 04O<O<O< !O< O<  O<  O<TzO<O<'-O<O< O<O<O<O