Skip to content

Ozone provider's impovement#36

Open
luserg wants to merge 5 commits into2.11.1-developfrom
feature/ozone-improvement
Open

Ozone provider's impovement#36
luserg wants to merge 5 commits into2.11.1-developfrom
feature/ozone-improvement

Conversation

@luserg
Copy link
Copy Markdown
Collaborator

@luserg luserg commented Apr 23, 2026

Ozone provider's impovement

  1. Replace module-level env-derived example constants in the Ozone example DAGs with DAG params / Param(...) definitions. Task https://tracker.yandex.ru/ADO-548
  2. Split timeout in Sensor and Parent class. Task https://tracker.yandex.ru/ADO-569
  3. Support Kerberos authentication via principal + password. Task https://tracker.yandex.ru/ADO-547
  4. Add more integrational tests
  5. Add if_exists parameter for some FS operations in ozone.

WARNING: param fail_if_exists in OzoneFsHook.create_path has been deprecated and replaced on if_exists with new type ExistingTargetPolicy = Literal["error", "ignore", "overwrite"]!

@luserg luserg requested review from gaxeliy and iamlapa April 23, 2026 13:13
@luserg luserg self-assigned this Apr 23, 2026
recursive: bool = True,
fail_if_exists: bool = False,
if_exists: ExistingTargetPolicy = "ignore",
) -> None:
Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

! BROKE BACKWARDS COMPATIBILITY:
The fail_if_exists argument has been removed and replaced with if_exists with a new type.

@luserg
Copy link
Copy Markdown
Collaborator Author

luserg commented May 4, 2026

May be we need add info about change to
https://github.com/arenadata/airflow/blob/2.11.1-develop/airflow/providers/arenadata/ozone/CHANGELOG.rst
with new version 1.0.1 ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant