Skip to content

ClickHouse monthly partitioning + Doris file-descriptor limits#11

Draft
mattstratton wants to merge 1 commit into
mainfrom
chore/sync-clickhouse-partitioning-and-doris-fdlimit
Draft

ClickHouse monthly partitioning + Doris file-descriptor limits#11
mattstratton wants to merge 1 commit into
mainfrom
chore/sync-clickhouse-partitioning-and-doris-fdlimit

Conversation

@mattstratton

Copy link
Copy Markdown
Collaborator

Two independent benchmark fixes from our internal copy. Draft pending review.

  • clickhouse/create.sql — add PARTITION BY toYYYYMM(event_created) to order_events. ClickHouse Cloud inherits this automatically via the clickhouse-cloud/create.sql symlink, so both stay consistent.
  • doris/benchmark.sh — start the Doris be/fe daemons under ulimit -n 655350 so the cluster comes up with proper file-descriptor limits (previously the ulimit didn't apply to the daemons).

Separate from #10 (the TimescaleDB modernization + rowcount tripwire); no file overlap, mergeable independently.

🤖 Generated with Claude Code

- clickhouse/create.sql: PARTITION BY toYYYYMM(event_created) on order_events.
  ClickHouse Cloud inherits this via the create.sql symlink.
- doris/benchmark.sh: start be/fe under `ulimit -n 655350` so Doris comes up
  with proper file-descriptor limits.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant