Skip to content

Implement error log retrieval via postgres and fix bugs#73

Merged
btravisebsco merged 7 commits intomainfrom
feature/better-aggregate-stats-handling-marc-data-import
Feb 3, 2026
Merged

Implement error log retrieval via postgres and fix bugs#73
btravisebsco merged 7 commits intomainfrom
feature/better-aggregate-stats-handling-marc-data-import

Conversation

@btravisebsco
Copy link
Contributor

Introduce a hard limit on concurrency for upsert operations in BatchPoster. Refactor configuration handling and progress reporting across several classes. Add a new function to preprocess MARC records by removing non-numeric fields. Introduce the DILogRetriever class for retrieving DI error logs and implement related tests. Update the version and add a dependency for PostgreSQL support.

… BatchPoster, MARCImportJob, and UserImporter classes
- Added logging for PostgreSQL tunnel connection.
- Updated remove_non_numeric_fields function to provide clearer logging messages for removed fields.
- Modified test cases to include no_progress flag for MARC import job.
@btravisebsco btravisebsco merged commit 14d85b9 into main Feb 3, 2026
5 checks passed
@btravisebsco btravisebsco deleted the feature/better-aggregate-stats-handling-marc-data-import branch February 3, 2026 16:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants