feat: Support roundtrip ListView in parquet arrow writer#9352
Open
codephage2020 wants to merge 15 commits intoapache:mainfrom
Open
feat: Support roundtrip ListView in parquet arrow writer#9352codephage2020 wants to merge 15 commits intoapache:mainfrom
codephage2020 wants to merge 15 commits intoapache:mainfrom
Conversation
Support roundtrip ListView in parquet arrow writer
…tch arm simplifying the code while preserving existing behavior.
Consolidate handling of DataType::List, LargeList, ListView, and LargeListView into a single build_list_reader flow.
This assumes the inner reader always returns a GenericListArray and simplifies error handling.
Support roundtrip ListView in parquet arrow writer
…tch arm simplifying the code while preserving existing behavior.
Consolidate handling of DataType::List, LargeList, ListView, and LargeListView into a single build_list_reader flow.
This assumes the inner reader always returns a GenericListArray and simplifies error handling.
codephage2020
force-pushed
the
issue-9344
branch
from
5bbe254 to
b4ba7f1
Compare
Contributor
Author
Jefffrey
reviewed
Feb 6, 2026
| .expect("ListViewArrayReader: inner reader must return GenericListArray"); | ||
|
|
||
| let list_view_array = | ||
| Arc::new(GenericListViewArray::<OffsetSize>::from(list_array.clone())); |
Contributor
There was a problem hiding this comment.
I suppose this is the easiest way to do this for now; maybe in followup we can explore ways to read directly into listview without going through a listarray, if there is potential performance benefit 👍
…into issue-9344
Co-Authored-By: Jeffrey Vo <jeffreyvo@apache.org>
Jefffrey
approved these changes
Feb 6, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Which issue does this PR close?
ListViewin parquet arrow writer #9344 .Rationale for this change
This PR implements support for roundtrip reading and writing of ListView and LargeListView types in Parquet Arrow integration.
What changes are included in this PR?
Are these changes tested?
YES
Are there any user-facing changes?
Users can now write and read ListView/LargeListView arrays to/from Parquet files