From afd4c361cdc2cbc822cbb0fd1ca6ebb265cdb81b Mon Sep 17 00:00:00 2001 From: Geoff Genz Date: Sun, 14 Jun 2026 13:54:53 -0600 Subject: [PATCH] Update ClickPipes maximum message sizes --- .../data-ingestion/clickpipes/kafka/04_best_practices.md | 2 +- .../data-ingestion/clickpipes/kinesis/01_overview.md | 2 +- .../data-ingestion/clickpipes/pubsub/01_overview.md | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/integrations/data-ingestion/clickpipes/kafka/04_best_practices.md b/docs/integrations/data-ingestion/clickpipes/kafka/04_best_practices.md index 1e0ad1ba1ca..06bfe826738 100644 --- a/docs/integrations/data-ingestion/clickpipes/kafka/04_best_practices.md +++ b/docs/integrations/data-ingestion/clickpipes/kafka/04_best_practices.md @@ -20,7 +20,7 @@ To learn more about message compression in Kafka, we recommend starting with thi ## Limitations {#limitations} - [`DEFAULT`](/sql-reference/statements/create/table#default) is not supported. -- Individual messages are limited to 2MB (uncompressed) by default when running with the smallest (XS) replica size, and 8MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. +- Individual messages are limited to 16MB (uncompressed) by default when running with the smallest (XS) replica size, and 32MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. ## Delivery semantics {#delivery-semantics} ClickPipes for Kafka provides `at-least-once` delivery semantics (as one of the most commonly used approaches). We'd love to hear your feedback on delivery semantics [contact form](https://clickhouse.com/company/contact?loc=clickpipes). If you need exactly-once semantics, we recommend using our official [`clickhouse-kafka-connect`](https://clickhouse.com/blog/real-time-event-streaming-with-kafka-connect-confluent-cloud-clickhouse) sink. diff --git a/docs/integrations/data-ingestion/clickpipes/kinesis/01_overview.md b/docs/integrations/data-ingestion/clickpipes/kinesis/01_overview.md index 4eab93724bd..c536bcb6d72 100644 --- a/docs/integrations/data-ingestion/clickpipes/kinesis/01_overview.md +++ b/docs/integrations/data-ingestion/clickpipes/kinesis/01_overview.md @@ -159,7 +159,7 @@ view). For such pipes, it may improve ClickPipes performance to delete all the ## Limitations {#limitations} - [DEFAULT](/sql-reference/statements/create/table#default) isn't supported. -- Individual messages are limited to 8MB (uncompressed) by default when running with the smallest (XS) replica size, and 16MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. +- Individual messages are limited to 16MB (uncompressed) by default when running with the smallest (XS) replica size, and 32MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. ## Performance {#performance} diff --git a/docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md b/docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md index e4d3f7191ae..f1f428f8f30 100644 --- a/docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md +++ b/docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md @@ -185,7 +185,7 @@ The `_raw_message` field can be used in cases where only the full Pub/Sub messag ## Limitations {#limitations} - [DEFAULT](/sql-reference/statements/create/table#default) isn't supported. -- Individual messages are limited to 8MB (uncompressed) by default when running with the smallest (XS) replica size, and 16MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. +- Individual messages are limited to 16MB (uncompressed) by default when running with the smallest (XS) replica size, and 32MB (uncompressed) with larger replicas. Messages that exceed this limit will be rejected with an error. If you have a need for larger messages, please contact support. - Pub/Sub subscription filters are immutable — changing the filter expression requires recreating the pipe. - Filters apply to message attributes only, not the message payload.