Skip to content

Initial refactoring of baseline functionality to support revised Nodes#21

Draft
jvanulde wants to merge 2 commits into
denevers:masterfrom
jvanulde:master
Draft

Initial refactoring of baseline functionality to support revised Nodes#21
jvanulde wants to merge 2 commits into
denevers:masterfrom
jvanulde:master

Conversation

@jvanulde

@jvanulde jvanulde commented May 5, 2022

Copy link
Copy Markdown
Collaborator

Moved to requests module for accessing Canadian node since it has a broken certificate chain allowing for option to skip certificate verification. Also, worked around issue where XML from US node is not valid, at least as far as RDFLib is concerned. @denevers please run crawler.py and review the output. Next steps are to containerize the harvester and have it post the triples to our data store.

@jvanulde jvanulde requested a review from denevers May 5, 2022 16:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant