How can I submit or request a benchmark report?

[tisonkun]

Hi here!

I'm working at @GreptimeTeam. We built a time-series database GreptimeDB and a cloud service GreptimeCloud.

We did benchmark ourselves on tsbs and wonder how we can submit the result to benchANT or request you experts to do a benchmark on our product.

Looking forward to your feedback :D

[tisonkun]

cc @seybi87 @jodoma

[seybi87]

Hi @tisonkun thanks for reaching out and your interest in our ranking.

We are always happy to include new databases in the ranking.

For adding new results, the benchmarks are executed via our benchmarking platform to ensure the same benchmark process and (as close as possible) configuration for all databases. In addition, our platform ensures the metadata collection for transparency and reproducibility.

Since you already did benchmarks against GreptimeDB, is there a TSBS fork with a GreptimeDB binding publicly available?

looking forward to continue the discussion!

[tisonkun]

@seybi87 Thanks for your reply! Glad to see that you're interested in adding new databases.

Since you already did benchmarks against GreptimeDB, is there a TSBS fork with a GreptimeDB binding publicly available?

Yes. We have a TSBS fork at https://github.com/GreptimeTeam/tsbs and we upload the result at https://github.com/GreptimeTeam/greptimedb/blob/main/docs/benchmarks/tsbs/v0.7.0.md.

For adding new results, the benchmarks are executed via our benchmarking platform to ensure the same benchmark process and (as close as possible) configuration for all databases.

This is reasonable. You may check the fork and result above to see what difference to your process so that we can align on benchmarking.

[evenyag]

This file lists commands we use to run the benchmark. Note that it doesn't support using this single script to execute the benchmark.
https://github.com/GreptimeTeam/tsbs/blob/6aeee450c3a7217cb4ad86ce163e261ae01360e1/scripts/greptimedb.sh

We have a data loader for GreptimeDB but don't have a dedicated query binding for GreptimeDB. We use the InfluxDB query binding to run queries. We added some HTTP headers in its request to make it compatible with our DB.