&`i`ddlmZ ddlZn #e$rdZYnwxYwdddefdZ d dd d edd fd ZdS))concat_tensor_arraysNpa_typezpyarrow.lib.DataTypereturnc6t|tjS)zfWhether the provided Arrow Table column is an extension array, using an Arrow extension type. ) isinstancepyarrow ExtensionType)rs r/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/ray/air/util/transform_pyarrow.py_is_pa_extension_typer s gw4 5 55Fcazpyarrow.ChunkedArray ensure_copyz pyarrow.Arraycddlm}t|jst d|}|jdkr!t jg|jj}nt|s%t|j dkr |j dSt|j|rt|j |St j d|j D}|j|S)aConcatenate chunks of an extension column into a contiguous array. This concatenation is required for creating copies and for .take() to work on extension arrays. See https://issues.apache.org/jira/browse/ARROW-16503. Args: ca: The chunked array representing the extension column to be concatenated. ensure_copy: Skip copying when ensure_copy is False and there is exactly 1 chunk. r) get_arrow_extension_tensor_typesz,Chunked array isn't an extension array: {ca})typecg|] }|j S)storage).0cs r z1_concatenate_extension_column../s(F(F(Fq(F(F(Fr )$ray.air.util.tensor_extensions.arrowrr r ValueError num_chunksrarray storage_typelenchunksrr concat_arrays wrap_array)r rrtensor_extension_typesrs r _concatenate_extension_columnr#s ! ) )IGHHH==?? }-)=>>> HS^^q00y| BG3 4 4H#BI{;;;'(F(FBI(F(F(FGG 7  g & &&r )F)rrr ImportErrorboolr r#rr r r&sEEEEEENNNNGGG6#96d66665:!'!'!'-1!'!'!'!'!'!'!'s