Skip to content

Adding Pangaea Provider pyleotups.core.PangaeaDataset and related tests#31

Merged
khider merged 12 commits intomainfrom
pangaea-tests
Mar 12, 2026
Merged

Adding Pangaea Provider pyleotups.core.PangaeaDataset and related tests#31
khider merged 12 commits intomainfrom
pangaea-tests

Conversation

@doswal
Copy link
Copy Markdown
Collaborator

@doswal doswal commented Mar 12, 2026

Description

This PR introduces the PangaeaDataset workflow, which focuses on Pangaea's metadata extraction, collection handling, variable access, data file access and supporting test infrastructure.

The work builds on previous refactoring efforts and aligns the implementation more closely with the pangaeapy object API.

Summary of Changes

PangaeaDataset

  • Initialize and integrate pangaeapy dependencies
  • Align metadata extraction with pangaeapy object API
  • Decouple Pan information extraction into a dedicated PangaeaStudy abstraction
  • Add temporal information extraction:
  • Add support for CollectionMembers in PangaeaSummary
  • Allow get_data() to automatically access collection member datasets when required
  • Add get_variables() method
  • Add credential manager for Pangaea access
  • Add warnings when collections are returned in search results
  • Remove debugging statements and fix minor bugs

Testing Infrastructure (pangaea-tests)

  • Add helper utilities for Pangaea loader
  • Add mock data for testing package tools
  • Add minimal test stubs to establish testing structure

doswal added 12 commits March 12, 2026 10:29
… API

Refactor funding and geo extraction to use attribute access instead of
dict-style getters. pangaeapy returns structured objects (events,
projects), not dictionaries.

Resolves incorrect funding and geometry parsing and prevents silent failures.
…gaeaDataset into PangaeaStudy; 3. Adding temporal info extraction for EarliestYearCE, etc.
…to access collection member dataset when required
…ed'as restricted regex expression for temporal information extraction
@doswal doswal requested a review from khider March 12, 2026 18:27
@khider khider merged commit 5633313 into main Mar 12, 2026
1 check passed
@doswal doswal deleted the pangaea-tests branch March 26, 2026 22:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants