Skip to content

Outputter for AWS Kinesis stream#34

Open
sodle wants to merge 10 commits intococcyx:masterfrom
sodle:master
Open

Outputter for AWS Kinesis stream#34
sodle wants to merge 10 commits intococcyx:masterfrom
sodle:master

Conversation

@sodle
Copy link
Contributor

@sodle sodle commented Jun 25, 2019

This outputter is able to send generated rows to Kinesis.

Events are partitioned by the host key and sent in batches of 500 (the max allowed by Kinesis). Simply specify kinesis as the outputter and the stream name as the endpoint argument to Gogen. Make sure that AWS is authenticated and set to the proper region, either through the ~/.aws/credentials file or the AWS_ environment variables.

@coccyx
Copy link
Owner

coccyx commented Aug 20, 2019

Nice! I'll review this this weekend (sorry I missed it sooner).

@sodle
Copy link
Contributor Author

sodle commented Aug 20, 2019 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants