Skip to content

Develop#14

Merged
matthewpeterkort merged 24 commits into
masterfrom
develop
Jun 11, 2026
Merged

Develop#14
matthewpeterkort merged 24 commits into
masterfrom
develop

Conversation

@matthewpeterkort

Copy link
Copy Markdown
Collaborator

No description provided.

matthewpeterkort and others added 12 commits December 18, 2025 09:56
* split client out further into more digestable parts

* simplify, factor business logic out of cmd package and into upload and download packages

* rearrange some more stuff. Start testing

* fix some bugs

* abstract out token handling into lowest level request interface

* fix a bunch of bugs

* adds very minimal docs
* fix missing error check

* Initial plan

* Fix error wrapping to preserve error chain using fmt.Errorf with %w

Co-authored-by: bwalsh <47808+bwalsh@users.noreply.github.com>

* Update PR description with completion status

Co-authored-by: bwalsh <47808+bwalsh@users.noreply.github.com>

* Add /bin/ to .gitignore and remove accidentally committed binary

Co-authored-by: bwalsh <47808+bwalsh@users.noreply.github.com>

---------

Co-authored-by: Brian Walsh <brian@bwalsh.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: bwalsh <47808+bwalsh@users.noreply.github.com>
* MinChunkSize: 10MB
* fix:improve-multipart #18
* improve OptimalChunkSize.scaleLinear
* adds optimal-chunk-size
* table-driven tests  GetLfsCustomTransferInt
* Address PR review comments: fix naming, formatting, and test coverage
* Add logging for git config errors and improve documentation structure
* Fix spelling: terrabytes → terabytes
* adds ProgressEvent
* Fix nil pointer dereferences and duplicate progress events
- Added nil check for req.Progress in multipart.go to prevent panic
- Removed duplicate progress event in singleFile.go (Finalize already emits)
- Fixed concurrent BytesSoFar calculation using atomic counter for monotonicity
* adds tests
* add noop ProgressCallback
* MinChunkSize: 10MB
* fix:improve-multipart #18
* improve OptimalChunkSize.scaleLinear
* adds optimal-chunk-size
* table-driven tests  GetLfsCustomTransferInt
* Initial plan
* Address PR review comments: fix naming, formatting, and test coverage
* Add logging for git config errors and improve documentation structure
* Fix spelling: terrabytes → terabytes
* refactor a bunch of stuff, incorporate latest commits on develop
* add g3client
* operational data-client
* tests passing
* add sower client
* fix up logging to pass back to main git-drs logger when configured
* addresse logging feedbacks
* add requestor client and commands
* add command validation for collaborator command
* fix up releaser
* fix PartNumber typo regression
* fix partNumber
@codecov

codecov Bot commented Feb 3, 2026

Copy link
Copy Markdown

Welcome to Codecov 🎉

Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.

ℹ️ You can also turn on project coverage checks and project coverage reporting on Pull Request comment

Thanks for integrating Codecov - We've got you covered ☂️

bwalsh and others added 2 commits February 5, 2026 08:05
* fix tests
* make progress logging tied to minChunkSize
* refactor/add-url #28
* typo
* improve onProgress bytesSinceReport >= 1MB
* OnProgressThreshold

---------

Co-authored-by: matthewpeterkort <matthewpeterkort@gmail.com>
@bwalsh

bwalsh commented Feb 11, 2026

Copy link
Copy Markdown
Contributor

@matthewpeterkort I think this has been done. If so can you close it?

@matthewpeterkort

Copy link
Copy Markdown
Collaborator Author

what you mean by close it ? last merge to main was months ago

@bwalsh

bwalsh commented Feb 11, 2026

Copy link
Copy Markdown
Contributor

@matthewpeterkort my mistake, I misread the target

matthewpeterkort and others added 4 commits March 3, 2026 08:33
* start refactor to support non-gen3 file handling backend

* continue build out backend for drs server

* lock down data-client version

* rearrange data client to support drs server

* update apigen

* add ci

* fix tests

* add client support for bulk url signing

* remove apigen from data-client

* fix imports

* move sifon client out of data-client into its own package in syfon repo

* fix test

* demisitify collaborators command
@github-actions

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 52.9%

Package Coverage

Package Coverage
conf 53.6%
fence 54.0%
g3client 27.8%
logs 53.0%
request 40.6%
requestor 81.2%
sower 75.0%

@github-actions

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 52.9%

Package Coverage

Package Coverage
conf 53.6%
fence 54.0%
g3client 27.8%
logs 53.0%
request 40.6%
requestor 81.2%
sower 75.0%

@github-actions

github-actions Bot commented May 4, 2026

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 55.6%

Package Coverage

Package Coverage
conf 52.1%
fence 54.0%
g3client 27.8%
logs 53.0%
request 40.6%
requestor 82.8%
sower 75.0%

@lbeckman314

lbeckman314 commented May 4, 2026

Copy link
Copy Markdown
Contributor

Review Steps 🌀

1. Install

https://github.com/calypr/data-client#installation

cd data-client

➜ git fetch --all

➜ git checkout develop

➜ git show --summary --oneline
8e9b714 (HEAD -> develop, origin/develop) update data client

➜ make
--> Building data-client...
Build successful! Binary placed in ./bin/data-client

➜ export PATH=$PATH:./bin

➜ which data-client
./bin/data-client

➜ data-client --version
data-client version 2026.2

2. Configure

https://github.com/calypr/data-client#enabling-new-gen3-object-management-api

Tip

credentials.json downloaded from calypr-dev.ohsu.edu/Profile

➜ data-client configure --profile=calypr-dev --cred=~/Downloads/credentials.json --apiendpoint=https://calypr-dev.ohsu.edu
Profile 'calypr-dev' has been configured successfully.

3. Upload

Without Metadata

Caution

Currently encountering a failed to get upload URL: 405 error, need to:

➜ data-client upload --profile=calypr-dev --upload-path=README.md --bucket calypr
level=ERROR msg="Upload failed" path=data-client/README.md error="failed to get upload URL: 405"
level=ERROR msg="Upload failed" error="failed to get upload URL: 405"

With Metadata

https://github.com/calypr/data-client#uploading-additional-file-object-metadata-to-gen3-object-management-api

➜ TODO

4. Download

➜ TODO

@github-actions

github-actions Bot commented May 6, 2026

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 58.6%

Package Coverage

Package Coverage
fence 54.0%
g3client 27.6%
logs 53.0%
request 74.8%
requestor 82.8%
sower 75.0%

@github-actions

github-actions Bot commented May 6, 2026

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 58.7%

Package Coverage

Package Coverage
conf 54.5%
fence 54.0%
g3client 27.6%
logs 53.0%
request 74.8%
requestor 82.8%
sower 75.0%

…es (#34)

* update data-client to add support for updated gecko, arborist codebases

* change name to calypr-cli

* cleanup
@github-actions

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 60.2%

Package Coverage

Package Coverage
arborist 77.1%
conf 54.7%
fence 54.0%
g3client 28.8%
gecko 74.4%
githubutil 53.2%
logs 53.0%
request 79.4%
requestor 84.7%
sower 83.3%

@github-actions

Copy link
Copy Markdown

Test Coverage Report

Overall Coverage: 60.2%

Package Coverage

Package Coverage
arborist 77.1%
conf 54.7%
fence 54.0%
g3client 28.8%
gecko 74.4%
githubutil 53.2%
logs 53.0%
request 79.4%
requestor 84.7%
sower 83.3%

@matthewpeterkort matthewpeterkort merged commit ad91289 into master Jun 11, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants