Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/apache/arrow/issues/26180 below:

[Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity overflows · Issue #26180 · apache/arrow · GitHub

I'm sorry if this was already reported, but there's an overflow issue in concatenation of large arrays

In [1]: import pyarrow as pa

In [2]: str_array = pa.array(['a' * 128] * 10**8)

In [3]: large_array = pa.concat_arrays([str_array] * 50)
Segmentation fault (core dumped)

I suppose that this should be handled by upcast to large_string.

Reporter: Artem KOZHEVNIKOV / @artemru

• .take silently overflow on list array (when casting to large_list is needed) (relates to)
• [C++][Parquet] Support LargeListArray (relates to)
• [C++] Take on string chunked arrays slow and fails (is related to)
• [C++][Python] Large strings cause ArrowInvalid: offset overflow while concatenating arrays (is superceded by)

_{Note: This issue was originally created as ARROW-10172. Please see the migration documentation for further details.}

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4