out_s3: major refactor to only upload in a single "daemon" routine#6919

Draft

PettitWesley wants to merge 17 commits intofluent:1.9from

PettitWesley:s3-fix-data-ordering-1_9

Commits on Feb 27, 2023

out_s3: use retry_limit in fluent-bit to replace MAX_UPLOAD_ERROR and update s3 warn output messages with function s3_retry_warn()

EC2 Default User
authored and
PettitWesley
committed
out_s3: remove unneeded code comments
PettitWesley
committed
out_s3: remove unnecesary chunk->failure check
PettitWesley
committed
out_s3: fix logic to be send then check failures/retries in put_all_chunks
PettitWesley
committed
out_s3: locking chunks is no longer needed for async http
PettitWesley
committed
out_s3: remove all existing upload_queue code
PettitWesley
committed
out_s3: multipart timeouts are processed after data upload or in the timer callback only
PettitWesley
committed
out_s3: refactor buffer_chunk to set input name
PettitWesley
committed
s3: set input_name on multipart from chunk
PettitWesley
committed
out_s3: now sends only happen from upload timer callback
PettitWesley
committed

Commits on Apr 11, 2023

out_s3: support no_retries and no_limits for retry limit, exit daemon coro on shutdown, send timed out chunks in daemon coro
PettitWesley
committed

Commits on May 2, 2023