Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/apache/arrow/issues/26738 below:

[C++] Take on string chunked arrays slow and fails · Issue #26738 · apache/arrow · GitHub

import pyarrow as pa
a = pa.array(['a'] * 2**26)
c = pa.chunked_array([a] * 2*18)
c.take([0, 1])

Gives

----------------------------------------
ArrowInvalidTraceback (most recent call last)
<ipython-input-4-57099ee02815> in <module>
----> 1 c.take([0, 1])

~/github/apache/arrow/python/pyarrow/table.pxi in pyarrow.lib.ChunkedArray.take()

~/github/apache/arrow/python/pyarrow/compute.py in take(data, indices, boundscheck, memory_pool)
    421     """
    422     options = TakeOptions(boundscheck=boundscheck)
--> 423     return call_function('take', [data, indices], options, memory_pool)
    424 
    425 

~/github/apache/arrow/python/pyarrow/_compute.pyx in pyarrow._compute.call_function()

~/github/apache/arrow/python/pyarrow/_compute.pyx in pyarrow._compute.Function.call()

~/github/apache/arrow/python/pyarrow/error.pxi in pyarrow.lib.pyarrow_internal_check_status()

~/github/apache/arrow/python/pyarrow/error.pxi in pyarrow.lib.check_status()

ArrowInvalid: offset overflow while concatenating arrays

PS: did not check master but  3.0.0.dev238+gb0bc9f8d

Reporter: Maarten Breddels / @maartenbreddels

• [C++] Take kernel can't handle ChunkedArrays that don't fit in an Array #25822 (duplicates)
• [Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity overflows #26180 (relates to)

_{Note: This issue was originally created as ARROW-10799. Please see the migration documentation for further details.}

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4