Self-Hosted Version
26.3.1
CPU Architecture
x86_64
Docker Version
29.4.0
Docker Compose Version
5.1.2
Machine Specification
Installation Type
Upgrade from 25.12.1 to 26.3.1
Steps to Reproduce
- Create an alert that sends an email on each error
- Cause error multiple times
Expected Result
Should send the newest error per email
Actual Result
Does not send the newest error per email but the second newest.
The events topic of the post-process-forwarder consumer group has a permanent lag of 1, maybe this could be the reason.
I've already tried to reset the offset and even deleted the kafka volume, but after the first error it does nothing and has a lag of 1 and after the second one it sends the first.
Had the same behaviour before the upgrade.
Log of post-process-forwarder-errors:
post-process-forwarder-errors-1 | 13:47:46 [INFO] arroyo.processing.strategies.run_task_with_multiprocessing: Starting init MultiprocessingPool class
post-process-forwarder-errors-1 | 13:47:46 [INFO] arroyo.processing.strategies.run_task_with_multiprocessing: Starting maybe_create_pool function
post-process-forwarder-errors-1 | 13:47:46 [INFO] arroyo.processing.strategies.run_task_with_multiprocessing: Finished maybe_create_pool function
post-process-forwarder-errors-1 | 13:47:46 [INFO] arroyo.processing.strategies.run_task_with_multiprocessing: Finished init MultiprocessingPool class
post-process-forwarder-errors-1 | 13:47:49 [INFO] arroyo.backends.kafka.consumer: Paused partitions after assignment: set()
post-process-forwarder-errors-1 | 13:47:49 [INFO] sentry.utils.arroyo.subprocess: _initialize_arroyo_subprocess: configure() complete
post-process-forwarder-errors-1 | 13:47:49 [INFO] sentry.utils.arroyo.subprocess: _initialize_arroyo_subprocess: calling add_global_tags()
post-process-forwarder-errors-1 | 13:47:49 [INFO] sentry.utils.arroyo.subprocess: _initialize_arroyo_subprocess: add_global_tags() complete
post-process-forwarder-errors-1 | 13:47:49 [INFO] arroyo.processing.strategies.run_task_with_multiprocessing: Finished parallel_worker_initializer function with pid 1045, elapsed time 2.843735
post-process-forwarder-errors-1 | 13:47:52 [INFO] arroyo.processing.processor: New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 15}
post-process-forwarder-errors-1 | 13:47:52 [INFO] arroyo.processing.processor: Member id: 'rdkafka-991a0391-9187-4d3a-84a7-19c341195588'
post-process-forwarder-errors-1 | 13:47:52 [INFO] sentry.post_process_forwarder.post_process_forwarder: Starting multithreaded post process forwarder
post-process-forwarder-errors-1 | 13:47:52 [INFO] arroyo.backends.kafka.consumer: Paused partitions after assignment: set()
Event ID
No response
Self-Hosted Version
26.3.1
CPU Architecture
x86_64
Docker Version
29.4.0
Docker Compose Version
5.1.2
Machine Specification
Installation Type
Upgrade from 25.12.1 to 26.3.1
Steps to Reproduce
Expected Result
Should send the newest error per email
Actual Result
Does not send the newest error per email but the second newest.
The
eventstopic of thepost-process-forwarderconsumer group has a permanent lag of 1, maybe this could be the reason.I've already tried to reset the offset and even deleted the kafka volume, but after the first error it does nothing and has a lag of 1 and after the second one it sends the first.
Had the same behaviour before the upgrade.
Log of post-process-forwarder-errors:
Event ID
No response