Skip to content

out_s3: major refactor to only upload in a single "daemon" routine #6919

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
PettitWesley wants to merge 17 commits into
base: 1.9
Choose a base branch
from
Draft

out_s3: major refactor to only upload in a single "daemon" routine #6919

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
6461537
out_s3: use retry_limit in fluent-bit to replace MAX_UPLOAD_ERROR and…
Sep 16, 2022
a951e0b
out_s3: remove unneeded code comments
PettitWesley Feb 24, 2023
14e133c
out_s3: remove unnecesary chunk->failure check
PettitWesley Feb 24, 2023
f5cfe3c
out_s3: fix logic to be send then check failures/retries in put_all_c…
PettitWesley Feb 24, 2023
5eaefee
out_s3: locking chunks is no longer needed for async http
PettitWesley Feb 24, 2023
cafd470
out_s3: remove all existing upload_queue code
PettitWesley Feb 24, 2023
984fe8e
out_s3: multipart timeouts are processed after data upload or in the …
PettitWesley Feb 24, 2023
076c361
out_s3: refactor buffer_chunk to set input name
PettitWesley Feb 27, 2023
105b4ce
s3: set input_name on multipart from chunk
PettitWesley Feb 27, 2023
a68f484
out_s3: now sends only happen from upload timer callback
PettitWesley Feb 27, 2023
78b0e2f
out_s3: daemon thread with code changes only in S3 plugin
PettitWesley Mar 28, 2023
e5f7be5
out_s3: do not use sync IO ever so do not upload in init callback?
PettitWesley Mar 28, 2023
0f6c2cc
out_s3: remove annoying info message
PettitWesley Mar 28, 2023
44b7c09
out_s3: ignore active stream in put_all_chunks on startup
PettitWesley Mar 28, 2023
2498ab7
out_s3: support no_retries and no_limits for retry limit, exit daemon…
PettitWesley Apr 11, 2023
b035d6f
out_s3: in upload_data, use input_name variable instead of from chunk
PettitWesley May 2, 2023
9efcca9
out_s3: re-enable send old chunks on startup
PettitWesley May 2, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading