Skip to content

PIPELINE-3363: Improve repository structure. Upgrade to Python 3.12 and Apache Beam 2.71#225

Merged
tomaslink merged 3 commits into
mainfrom
PIPELINE-3363-pipe-segment-improve-repository-structure
Mar 10, 2026
Merged

PIPELINE-3363: Improve repository structure. Upgrade to Python 3.12 and Apache Beam 2.71#225
tomaslink merged 3 commits into
mainfrom
PIPELINE-3363-pipe-segment-improve-repository-structure

Conversation

@tomaslink

@tomaslink tomaslink commented Mar 6, 2026

Copy link
Copy Markdown
Contributor

Several improvements:

  • Upgrade Python to 3.12. Also add tests for Python 3.13 so its ready for next migration.
  • Upgrade Apache Beam to 2.71
  • Optimized dockerfile in size and speed (starts using UV inside).
  • Properly distribute assets inside package.
  • Use pyproject.toml.
  • Add git workflow documentation.

https://globalfishingwatch.atlassian.net/browse/PIPELINE-3363

@tomaslink tomaslink self-assigned this Mar 6, 2026
@tomaslink tomaslink force-pushed the PIPELINE-3363-pipe-segment-improve-repository-structure branch 5 times, most recently from 224c6c0 to 4553caa Compare March 6, 2026 06:11
@tomaslink tomaslink force-pushed the PIPELINE-3363-pipe-segment-improve-repository-structure branch from 4553caa to 8373c59 Compare March 6, 2026 06:11
@tomaslink tomaslink changed the title PIPELINE-3363: Improve repository structure PIPELINE-3363: Improve repository structure. Upgrade to Python 3.12 and Beam 2.71 Mar 6, 2026
@tomaslink tomaslink changed the title PIPELINE-3363: Improve repository structure. Upgrade to Python 3.12 and Beam 2.71 PIPELINE-3363: Improve repository structure. Upgrade to Python 3.12 and Apache Beam 2.71 Mar 6, 2026
@tomaslink tomaslink force-pushed the PIPELINE-3363-pipe-segment-improve-repository-structure branch from 1dc9bf4 to 570acc7 Compare March 6, 2026 17:54
@tomaslink tomaslink requested a review from andres-arana March 6, 2026 18:11
@tomaslink tomaslink force-pushed the PIPELINE-3363-pipe-segment-improve-repository-structure branch from 570acc7 to 31e3d84 Compare March 7, 2026 16:29
@tomaslink tomaslink merged commit f4d39fe into main Mar 10, 2026
3 checks passed
@tomaslink tomaslink deleted the PIPELINE-3363-pipe-segment-improve-repository-structure branch March 10, 2026 02:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant