Skip to content

Disable csv tests temporarily & fix dask_cudf failure#22203

Merged
mroeschke merged 5 commits intorapidsai:pandas3from
galipremsagar:enable_ci
Apr 20, 2026
Merged

Disable csv tests temporarily & fix dask_cudf failure#22203
mroeschke merged 5 commits intorapidsai:pandas3from
galipremsagar:enable_ci

Conversation

@galipremsagar
Copy link
Copy Markdown
Contributor

@galipremsagar galipremsagar commented Apr 17, 2026

Description

This PR:

  • Temporarily disables csv reader tests that will be fixed by: Fix csv parsing bug & implement date_format #22094
  • Fixes dask_cudf test_tz_localize regression introduced by Fix datetime & timedelta failures in pandas test suite #22174. After
    that PR, DatetimeTZColumn.to_pandas() relies on a cached _local_time to
    produce correct values near DST transitions (the stored UTC column is
    inaccurate because tz_localize searchsorts a non-monotonic transition
    table). The cache was being dropped during concat_columns and again during
    the ColumnBase.create rewrap in Series._concat, so concatenated dask
    partitions fell back to the incorrect UTC path. This PR preserves
    _local_time through both steps when all inputs are DatetimeTZColumns
    with the cache present.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@galipremsagar galipremsagar requested a review from mroeschke April 17, 2026 22:26
@galipremsagar galipremsagar self-assigned this Apr 17, 2026
@galipremsagar galipremsagar added 3 - Ready for Review Ready for review by team Python Affects Python cuDF API. non-breaking Non-breaking change labels Apr 17, 2026
@galipremsagar galipremsagar requested a review from a team as a code owner April 17, 2026 22:26
@galipremsagar galipremsagar requested review from TomAugspurger and removed request for a team April 17, 2026 22:26
@GPUtester GPUtester moved this to In Progress in cuDF Python Apr 17, 2026
@galipremsagar galipremsagar added the improvement Improvement / enhancement to an existing function label Apr 17, 2026
Comment thread python/cudf/cudf/tests/input_output/test_csv.py Outdated
Comment thread python/cudf/cudf/tests/input_output/test_csv.py Outdated
@galipremsagar galipremsagar requested a review from mroeschke April 20, 2026 15:45
@galipremsagar galipremsagar changed the title Disable csv tests temporarily Disable csv tests temporarily & fix dask_cudf failure Apr 20, 2026
@galipremsagar
Copy link
Copy Markdown
Contributor Author

@mroeschke All jobs except pandas-test pass 🥳 . Could you give another review for new fix I pushed after your approval.

@galipremsagar galipremsagar requested a review from mroeschke April 20, 2026 18:32
Copy link
Copy Markdown
Contributor

@mroeschke mroeschke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

and "_local_time" in o.__dict__
for o in objs_with_len
):
result._local_time = concat_columns(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My hope is that if we can transition to relying on _utc_time in the future we can remove all of this. I suspect this is a symptom of a bug somewhere in DatetimeTZColumn

@mroeschke mroeschke merged commit 447cb94 into rapidsai:pandas3 Apr 20, 2026
94 of 97 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in cuDF Python Apr 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3 - Ready for Review Ready for review by team improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

3 participants