Skip to content

consumoor: remove kzg_commitments array from data column sidecar#805

Merged
Savid merged 1 commit intorelease/consumoorfrom
consumoor/remove-kzg-commitments-column
Apr 10, 2026
Merged

consumoor: remove kzg_commitments array from data column sidecar#805
Savid merged 1 commit intorelease/consumoorfrom
consumoor/remove-kzg-commitments-column

Conversation

@Savid
Copy link
Copy Markdown
Member

@Savid Savid commented Apr 8, 2026

Summary

  • Removes the kzg_commitments Array(FixedString(98)) column from the beacon_api_eth_v1_events_data_column_sidecar_local ClickHouse migration, as the data is redundant with the existing kzg_commitments_count field
  • Updates the consumoor beacon route (beacon_api_eth_v1_events_data_column_sidecar.gen.go) to remove the KzgCommitments struct field, constructor initialization, Input() entry, Reset() call, Snapshot() row, and adjusts the map capacity from 30 to 29
  • Removes the GetKzgCommitments() append logic from beacon_api_eth_v1_events_data_column_sidecar.go that serialized the commitments array into the batch

The libp2p gossipsub_data_column_sidecar route was already correct — it only had KzgCommitmentsCount, no array field.

Note: deploy/local/docker-compose/vector-kafka-clickhouse.yaml:657 still references .kzg_commitments in the beacon_api_eth_v1_events_blob_sidecar_formatted sink (which also takes data_column_sidecar input). This may need a separate update if that sink feeds the same table.

Test plan

  • Verify go build ./pkg/consumoor/... compiles cleanly
  • Verify golangci-lint passes on changed files
  • Confirm ClickHouse migration applies without errors on a fresh instance
  • Validate data column sidecar events are ingested correctly without the kzg_commitments column

🤖 Generated with Claude Code

The kzg_commitments Array(FixedString(98)) column is redundant since
kzg_commitments_count already captures the needed information. This
removes the column from the ClickHouse migration and strips the
corresponding field, serialization, reset, and snapshot logic from
the beacon consumoor route.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@Savid Savid merged commit 907206f into release/consumoor Apr 10, 2026
6 of 8 checks passed
@Savid Savid deleted the consumoor/remove-kzg-commitments-column branch April 10, 2026 01:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants