PiFNddlmZddlmZmZddlZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZddlZdd lmZmZdd lmZdd lmZmZdd lmZmZmZm Z ddl!m"Z"m#Z#m$Z$erddlm%Z%e j&e j'e j(e j)e j*e j+e j+dZ,e j(ej-dfe j+ej.e fe j&ej/dfe j'ej/dfe j)ej/dfe j0ej.dfe j*ej1dfiZ2ej/dej-dej.diZ3GddeZ4dS)) annotations) TYPE_CHECKINGAnyN)using_python_scalars) infer_dtype)iNaT)NoBufferPresent)cache_readonly)BaseMaskedDtype) ArrowDtypeDatetimeTZDtype)is_string_dtype) PandasBufferPandasBufferPyarrow)Column ColumnBuffersColumnNullType DtypeKind) ArrowCTypes Endiannessdtype_to_arrow_c_fmt)Buffer)iufbUMmzThis column is non-nullablezThis column uses NaN as nullz!This column uses a sentinel valueceZdZdZd"d#d Zd$d Zed$d Zed%dZ d%dZ edZ edZ ed$dZ ed&dZd$dZd'd(dZd)dZd*dZd+dZd,d!ZdS)- PandasColumna A column object, with only the methods and properties required by the interchange protocol defined. A column can contain one or more chunks. Each chunk can contain up to three buffers - a data buffer, a mask buffer (depending on null representation), and an offsets buffer (if variable-size binary; e.g., variable-length strings). Note: this Column object can only be produced by ``__dataframe__``, so doesn't need its own version or ``__column__`` protocol. Tcolumn pd.Series allow_copyboolreturnNonect|tjrtd|jdt|tjs t dt|d||_||_ dS)zu Note: doesn't deal with extension arrays yet, just assume a regular Series/ndarray for now. zExpected a Series, got a DataFrame. This likely happened because you called __dataframe__ on a DataFrame which, after converting column names to string, resulted in duplicated names: zD. Please rename these columns before using the interchange protocol.zColumns of type  not handled yetN) isinstancepd DataFrame TypeErrorcolumnsSeriesNotImplementedErrortype_col _allow_copy)selfr#r%s r/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/pandas/core/interchange/column.py__init__zPandasColumn.__init__Vs fbl + + 2!.222 &"),, Y%&Wf&W&W&WXX X %intc|jjS)z2 Size of the column, in elements. )r3sizer5s r6r;zPandasColumn.sizejsy~r8cdS)z7 Offset of first element. Always zero. rr<s r6offsetzPandasColumn.offsetps qr8tuple[DtypeKind, int, str, str]c|jj}t|tjrJ|jjj}||j\}}}}tj ||tj fSt|rLt|jdvr'tjdt|tj fSt!d||S)N)stringemptyz.Non-string object dtypes are not supported yet)r3dtyper+r,CategoricalDtypevaluescodes_dtype_from_pandasdtyper CATEGORICALrNATIVErrSTRINGrr1)r5rErH_bitwidthc_arrow_dtype_f_strs r6rEzPandasColumn.dtypexs  eR0 1 1 7I$*E ,,U[99  #%#!   U # # 749%%)<<<$(//%  &&VWW W//66 6r8ct|jd}|td|dt |t r |jj}nKt |tr |j j}n)t |tr |jj}n|j}|dkr||j tj |fS||j dzt||fS)z/ See `self.dtype` for details. N Data type z& not supported by interchange protocolz bool[pyarrow]rD) _NP_KINDSgetkind ValueErrorr+r numpy_dtype byteorderr baser itemsizerBOOLr)r5rErTrWs r6rIz$PandasColumn._dtype_from_pandasdtypes}}UZ.. <W%WWWXX X eZ ( ( ()3II  / / ( ,II  / / ()3III O # #   U^a')=e)D)DiOOr8c|jdtjkstd|jjjdttj |jjj dS)a: If the dtype is categorical, there are two options: - There are only values in the data buffer. - There is a separate non-categorical Column encoding for categorical values. Raises TypeError if the dtype is not categorical Content of returned dict: - "is_ordered" : bool, whether the ordering of dictionary indices is semantically meaningful. - "is_dictionary" : bool, whether a dictionary-style mapping of categorical values to other objects exists - "categories" : Column representing the (implicit) mapping of indices to category values (e.g. an array of cat1, cat2, ...). None if not a dictionary-style categorical. rzCdescribe_categorical only works on a column with categorical dtype!T) is_ordered is_dictionary categories) rErrJr.r3catorderedr"r,r0r^r<s r6describe_categoricalz!PandasColumn.describe_categoricalsg$z!} 555U  )-/!&ry1I'J'JKK   r8ct|jjtrtj}d}||fSt|jjt rP|jjjj d dtj dfStj dfS|jd} t|\}}n&#t$r}td|d|d}~wwxYw||fS)NrrQz not yet supported)r+r3rEr r USE_BYTEMASKr array _pa_arraychunksbuffers NON_NULLABLE USE_BITMASK_NULL_DESCRIPTIONKeyErrorr1)r5column_null_dtype null_valuerTnullvalueerrs r6 describe_nullzPandasColumn.describe_nulls dio 7 7 1 . ; J$j0 0 dioz 2 2 1y(/2::<r<s r6 num_chunkszPandasColumn.num_chunkss qr8Nn_chunks int | Nonec#K|rr|dkrlt|j}||z}||zdkr|dz }td||z|D].}t|jj|||z|jV/dS|VdS)zy Return an iterator yielding the chunks. See `DataFrame.get_chunks` for details on ``n_chunks``. rcrN)lenr3ranger"ilocr4)r5rr;stepstarts r6 get_chunkszPandasColumn.get_chunkss  1 ty>>D8#Dh!## q$/488  "IN554<#78$:J   JJJJJr8rc|ddd} ||d<n#t$rYnwxYw ||d<n#t$rYnwxYw|S)a` Return a dictionary containing the underlying buffers. The returned dictionary has the following contents: - "data": a two-element tuple whose first element is a buffer containing the data and whose second element is the data buffer's associated dtype. - "validity": a two-element tuple whose first element is a buffer containing mask values indicating missing data and whose second element is the mask value buffer's associated dtype. None if the null representation is not a bit or byte mask. - "offsets": a two-element tuple whose first element is a buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and whose second element is the offsets buffer's associated dtype. None if the data buffer does not have an associated offsets buffer. N)datavalidityoffsetsrr)_get_data_buffer_get_validity_bufferr _get_offsets_buffer)r5rhs r6 get_bufferszPandasColumn.get_bufferss())++" "   "&";";"="=GJ      D  !%!9!9!;!;GI      D s2 ??A A('A(.tuple[Buffer, tuple[DtypeKind, int, str, str]]c|jdtjkrt|jddkr2|jjd}n|j}t||j }tj dtj tjf}nF|jdtj tjtjtjfvr|j}|jj}t'|jjt(rL|jjd}t/|dt|}||fSt'|jjt2r|j}n|j}t||j }nG|jdtjkrB|jjj}t||j }||j}n|jdtj kr|j}tC}|D]@}t'|tDr)|#|$d AttKj&|d }tjd tj'tjf}ntQd|jjd||fS)zZ Return the buffer containing the data and the buffer's associated dtype. rN)r%@rclengthutf-8encodinguint8)rErDrQr*))rErDATETIMErr3dt tz_convertto_numpyrr4INTrINT64rrKUINTFLOATrZrer+r rfrgrrhr _data_ndarrayrJrG_codesrIrL bytearraystrextendencodenp frombufferUINT8r1) r5np_arrbufferrEarrrHbufrobjs r6rzPandasColumn._get_data_buffer5s :a=I. . .4:a=!!A%%0066??AA++--!&T5EFFFF !! EE Z] M N O N    JE)/C$)/:66 %m*1-,KKMM!$s88u}$$)/?;; &!&T5EFFFFF Z]i3 3 3I$+E!%D4DEEEF00==EE Z]i. . .)$$&&C A ; ;c3'';HHSZZZ99:::""-"A"A"ABBF !! EE&&T49?&T&T&TUU Uu}r8tuple[Buffer, Any] | Nonecz|j\}}t|jjtr|jjjjd}tj dtj tj f}| ddSt| dt|}||fSt|jjt rH|jjj}t%|}tj dtj tj f}||fS|jdtjkr|j}|dk}| }t+jt|ft*j}t1|D]!\} } t| t2r|n||| <"t%|}tj dtj tj f}||fS t4|d} n"#t6$r} t9d| d} ~ wwxYwt;| ) z Return the buffer containing the mask values indicating missing data and the buffer's associated dtype. Raises NoBufferPresent if null representation is not a bit or byte mask. rrcNrrDshaperEz! so does not have a separate maskzSee self.describe_null)rrr+r3rEr rerfrgrrZrrrKrhrrr _maskrrLrrzerosbool_ enumerater_NO_VALIDITY_BUFFERrlr1r ) r5roinvalidrrErmaskrvalidrrmsgrqs r6rz!PandasColumn._get_validity_buffers * g dioz 2 2 !)/+215C^Q (8*:KLE{{}}Q't( a 3xxF5= dio 7 7 !9?(D!$''F^Q (8*:KLE5= :a=I, , ,)$$&&CqLEiG83s88+RX>>>D#C.. E E3#-c3#7#7D%%WQ"$''F^Q (8*:KLE5=  I(.QQQCC I I I%&>??S H Ic"""s;H H+H&&H+tuple[PandasBuffer, Any]c|jdtjkr|j}d}t jt|dzft j}t|D]J\}}t|tr(| d}|t|z }|||dz<Kt|}tjdtjt"jf}nt'd||fS)a Return the buffer containing the offset values for variable-size binary data (e.g., variable-length strings) and the buffer's associated dtype. Raises NoBufferPresent if the data buffer does not have an associated offsets buffer. rrcrrrrzJThis column has a fixed-length dtype so it does not have an offsets buffer)rErrLr3rrrrint64rr+rrrrrrrrKr ) r5rGptrrrvrrrEs r6rz PandasColumn._get_offsets_buffers :a=I, , ,Y''))FChc&kkAo%7rxHHHG!&)) % %1a%%"'22A3q66MC!$A"'**F !! EE"5  u}r8)T)r#r$r%r&r'r()r'r9)r'r@)r'ry)N)rr)r'r)r'r)r'r)r'r)__name__ __module__ __qualname____doc__r7r;propertyr?r rErIrarrrxr|r~rrrrrr>r8r6r"r"Js  &&&&&( X777^7:PPPPB  X 8X&^111X1  "####JIIIIV7#7#7#7#r&&&&&&r8r")5 __future__rtypingrrnumpyrpandas._configrpandas._libs.librpandas._libs.tslibsr pandas.errorsr pandas.util._decoratorsr pandas.core.dtypes.dtypesr pandasr,r r pandas.api.typesrpandas.core.interchange.bufferrr*pandas.core.interchange.dataframe_protocolrrrrpandas.core.interchange.utilsrrrrrrrrZrLrrRUSE_NAN USE_SENTINELrirJrdrkrr"r>r8r6rs"""""" //////(((((($$$$$$))))))222222555555-,,,,,  BAAAAAA             On,d3 4d; MN/6 N^0$7 N^0$7N7< ~2A6 !>:!DUUUUU6UUUUUr8