Skip to content

classify 'Bad query specified' as retryable#4181

Merged
jgao54 merged 1 commit intomainfrom
docdb-err
Apr 15, 2026
Merged

classify 'Bad query specified' as retryable#4181
jgao54 merged 1 commit intomainfrom
docdb-err

Conversation

@jgao54
Copy link
Copy Markdown
Contributor

@jgao54 jgao54 commented Apr 15, 2026

DocumentDB-only transient error that succeeds on retry.

Fixes: https://linear.app/clickhouse/issue/DBI-673/

@jgao54 jgao54 enabled auto-merge (squash) April 15, 2026 08:59
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 15, 2026

❌ 2 Tests Failed:

Tests completed Failed Passed Skipped
2216 2 2214 187
View the top 3 failed test(s) by shortest run time
github.com/PeerDB-io/peerdb/flow/e2e::TestApiMongo
Stack Traces | 0s run time
=== RUN   TestApiMongo
=== PAUSE TestApiMongo
=== CONT  TestApiMongo
--- FAIL: TestApiMongo (0.00s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestMirrorValidation_InvalidTableMappings/empty_destination
Stack Traces | 0s run time
=== RUN   TestApiPg/TestMirrorValidation_InvalidTableMappings/empty_destination
    api_test.go:443: 
        	Error Trace:	.../flow/e2e/congen.go:43
        	            				.../flow/e2e/pg.go:190
        	            				.../flow/e2e/pg.go:178
        	            				.../flow/e2e/api_test.go:443
        	Error:      	Received unexpected error:
        	            	unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
        	Test:       	TestApiPg/TestMirrorValidation_InvalidTableMappings/empty_destination
--- FAIL: TestApiPg/TestMirrorValidation_InvalidTableMappings/empty_destination (0.00s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiMy
Stack Traces | 0.01s run time
=== RUN   TestApiMy
=== PAUSE TestApiMy
=== CONT  TestApiMy
--- FAIL: TestApiMy (0.01s)
2026/04/15 09:12:11 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:12:11 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg
Stack Traces | 0.01s run time
=== RUN   TestApiPg
=== PAUSE TestApiPg
=== CONT  TestApiPg
--- FAIL: TestApiPg (0.01s)
2026/04/15 10:05:45 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 10:05:45 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 10:05:45 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id"
2026/04/15 10:05:45 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id"
2026/04/15 10:05:45 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9077168688086545847 CURSOR FOR SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id" args=[]
2026/04/15 10:05:45 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id" channelLen=0
2026/04/15 10:05:45 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9077168688086545847
2026/04/15 10:05:45 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9077168688086545847 records=2 bytes=8 channelLen=1
2026/04/15 10:05:45 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id" rows=2 bytes=8 channelLen=1
2026/04/15 10:05:45 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9077168688086545847
2026/04/15 10:05:45 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9077168688086545847 records=0 bytes=0 channelLen=0
2026/04/15 10:05:45 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 10:05:45 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 10:05:45 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id FROM e2e_test_pgch_rhobuwfn.\"test_infinite_time\" ORDER BY id" rows=2 bytes=8 channelLen=0
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestMirrorValidation_InvalidTableMappings
Stack Traces | 0.11s run time
=== RUN   TestApiPg/TestMirrorValidation_InvalidTableMappings
=== PAUSE TestApiPg/TestMirrorValidation_InvalidTableMappings
=== CONT  TestApiPg/TestMirrorValidation_InvalidTableMappings
2026/04/15 09:51:04 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:51:04 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    api_test.go:48: begin tearing down postgres schema api_z9jnyizu
--- FAIL: TestApiPg/TestMirrorValidation_InvalidTableMappings (0.11s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestTableAdditionWithoutInitialLoad
Stack Traces | 5.15s run time
=== RUN   TestApiPg/TestTableAdditionWithoutInitialLoad
=== PAUSE TestApiPg/TestTableAdditionWithoutInitialLoad
=== CONT  TestApiPg/TestTableAdditionWithoutInitialLoad
2026/04/15 10:03:47 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 10:03:47 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
    api_test.go:2284: WaitFor wait for initial load to finish 2026-04-15 10:03:51.905705242 +0000 UTC m=+315.813904932
2026/04/15 10:03:51 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id"
2026/04/15 10:03:51 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id"
2026/04/15 10:03:51 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9195271048845637987 CURSOR FOR SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id" args=[]
2026/04/15 10:03:51 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id" channelLen=0
2026/04/15 10:03:51 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9195271048845637987
2026/04/15 10:03:51 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9195271048845637987 records=1 bytes=9 channelLen=0
2026/04/15 10:03:51 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/15 10:03:51 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9195271048845637987
2026/04/15 10:03:51 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9195271048845637987 records=0 bytes=0 channelLen=0
2026/04/15 10:03:51 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 10:03:51 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 10:03:51 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_ujfzqj5c.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
    api_test.go:2294: WaitFor wait for pause for add table 2026-04-15 10:03:51.92198632 +0000 UTC m=+315.830186010
    api_test.go:2295: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:48: begin tearing down postgres schema api_ujfzqj5c
--- FAIL: TestApiPg/TestTableAdditionWithoutInitialLoad (5.15s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiMy/TestCancelTableAdditionRemoveAddRemove
Stack Traces | 13.1s run time
=== RUN   TestApiMy/TestCancelTableAdditionRemoveAddRemove
=== PAUSE TestApiMy/TestCancelTableAdditionRemoveAddRemove
=== CONT  TestApiMy/TestCancelTableAdditionRemoveAddRemove
2026/04/15 09:10:43 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:10:43 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:10:44 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_vndssayg.table1
    cancel_table_addition_test.go:637: WaitFor wait for initial load to finish 2026-04-15 09:10:49.894091842 +0000 UTC m=+513.285681475
    cancel_table_addition_test.go:641: WaitFor t1 2026-04-15 09:10:49.894582721 +0000 UTC m=+513.286172343
2026/04/15 09:10:49 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_d6hlx3uy.t1
    cancel_table_addition_test.go:642: WaitFor t2 2026-04-15 09:10:49.903763965 +0000 UTC m=+513.295353607
2026/04/15 09:10:49 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_d6hlx3uy.t2
    cancel_table_addition_test.go:82: WaitFor wait for pause for remove e2e_test_api_d6hlx3uy.t2 2026-04-15 09:10:49.915005107 +0000 UTC m=+513.306594740
    cancel_table_addition_test.go:83: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:48: begin tearing down postgres schema api_d6hlx3uy
--- FAIL: TestApiMy/TestCancelTableAdditionRemoveAddRemove (13.12s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiMongo/TestCancelTableAddition_NoRemovalAssumed
Stack Traces | 16.1s run time
=== RUN   TestApiMongo/TestCancelTableAddition_NoRemovalAssumed
=== PAUSE TestApiMongo/TestCancelTableAddition_NoRemovalAssumed
=== CONT  TestApiMongo/TestCancelTableAddition_NoRemovalAssumed
2026/04/15 09:04:08 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:04:08 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:04:08 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_mychg_4oy2ft9f.test_simple_schema_changes
    cancel_table_addition_test.go:362: WaitFor wait for initial load to finish 2026-04-15 09:04:16.471348261 +0000 UTC m=+31.503955518
    cancel_table_addition_test.go:366: WaitFor t1 initial load 2026-04-15 09:04:16.471741338 +0000 UTC m=+31.504348595
    cancel_table_addition_test.go:367: WaitFor t2 initial load 2026-04-15 09:04:16.476105376 +0000 UTC m=+31.508712643
    cancel_table_addition_test.go:368: WaitFor t3 initial load 2026-04-15 09:04:16.479797832 +0000 UTC m=+31.512405099
    cancel_table_addition_test.go:376: WaitFor wait for pause for add table 2026-04-15 09:04:16.486273521 +0000 UTC m=+31.518880779
    cancel_table_addition_test.go:377: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:48: begin tearing down postgres schema api_a7xdpsms
--- FAIL: TestApiMongo/TestCancelTableAddition_NoRemovalAssumed (16.13s)
github.com/PeerDB-io/peerdb/flow/e2e::TestApiPg/TestEditTablesBeforeResync
Stack Traces | 42.2s run time
=== RUN   TestApiPg/TestEditTablesBeforeResync
=== PAUSE TestApiPg/TestEditTablesBeforeResync
=== CONT  TestApiPg/TestEditTablesBeforeResync
2026/04/15 09:28:21 INFO Received AWS credentials from peer for connector: ci x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:28:21 INFO Received AWS credentials from peer for connector: clickhouse x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN}
2026/04/15 09:28:21 INFO queued schema delta update x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} flowName=test_cancel_error_on_pg_zero_oids_api_npz4ftlt tableName=t1
    api_test.go:1668: WaitFor wait for initial load to finish 2026-04-15 09:28:25.613789724 +0000 UTC m=+427.293753019
2026/04/15 09:28:25 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id"
2026/04/15 09:28:25 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id"
2026/04/15 09:28:25 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_7839692902574337756 CURSOR FOR SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id" args=[]
2026/04/15 09:28:25 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id" channelLen=0
2026/04/15 09:28:25 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7839692902574337756
2026/04/15 09:28:25 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7839692902574337756 records=1 bytes=9 channelLen=0
2026/04/15 09:28:25 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
2026/04/15 09:28:25 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7839692902574337756
2026/04/15 09:28:25 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_7839692902574337756 records=0 bytes=0 channelLen=0
2026/04/15 09:28:25 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 09:28:25 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 09:28:25 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"original\" ORDER BY id" rows=1 bytes=9 channelLen=0
    api_test.go:1679: WaitFor wait for pause for add table 2026-04-15 09:28:25.629868146 +0000 UTC m=+427.309831431
    api_test.go:1699: WaitFor wait for table addition to finish 2026-04-15 09:28:27.635573902 +0000 UTC m=+429.315537197
    api_test.go:104: WaitFor sync flow check: cdc after add table 2026-04-15 09:28:33.651605604 +0000 UTC m=+435.331568909
2026/04/15 09:28:33 INFO fetched schema x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} table=e2e_test_api_mmeyghlt.t1
    api_test.go:117: WaitFor normalize flow check: cdc after add table 2026-04-15 09:28:49.665566012 +0000 UTC m=+451.345529307
2026/04/15 09:28:49 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id"
2026/04/15 09:28:49 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id"
2026/04/15 09:28:49 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_8772212607680976176 CURSOR FOR SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id" args=[]
2026/04/15 09:28:49 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id" channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_8772212607680976176
2026/04/15 09:28:49 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_8772212607680976176 records=2 bytes=28 channelLen=1
2026/04/15 09:28:49 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id" rows=2 bytes=28 channelLen=1
2026/04/15 09:28:49 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_8772212607680976176
2026/04/15 09:28:49 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_8772212607680976176 records=0 bytes=0 channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 09:28:49 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_oivqedbt.\"added\" ORDER BY id" rows=2 bytes=28 channelLen=0
    api_test.go:1741: WaitFor wait for pause for remove table 2026-04-15 09:28:49.676294441 +0000 UTC m=+451.356257736
2026/04/15 09:28:49 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id"
2026/04/15 09:28:49 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id"
2026/04/15 09:28:49 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_9294739521419541865 CURSOR FOR SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id" args=[]
2026/04/15 09:28:49 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id" channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9294739521419541865
2026/04/15 09:28:49 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9294739521419541865 records=2 bytes=19 channelLen=1
2026/04/15 09:28:49 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/15 09:28:49 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9294739521419541865
2026/04/15 09:28:49 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_9294739521419541865 records=0 bytes=0 channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 09:28:49 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 09:28:49 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_bm9uejm0.\"table1\" ORDER BY id" rows=2 bytes=19 channelLen=0
    api_test.go:1742: UNEXPECTED ERROR unable to establish connection with catalog: FATAL: terminating connection due to administrator command (SQLSTATE 57P01)
    api_test.go:48: begin tearing down postgres schema api_oivqedbt
2026/04/15 09:28:58 INFO Executing and processing query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id"
2026/04/15 09:28:58 INFO Executing and processing query stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id"
2026/04/15 09:28:58 INFO [pg_query_executor] declared cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursorQuery="DECLARE peerdb_cursor_14643343661038434741 CURSOR FOR SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id" args=[]
2026/04/15 09:28:58 INFO [pg_query_executor] fetching rows start x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id" channelLen=0
2026/04/15 09:28:58 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14643343661038434741
2026/04/15 09:28:58 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14643343661038434741 records=2 bytes=19 channelLen=1
2026/04/15 09:28:58 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id" rows=2 bytes=19 channelLen=1
2026/04/15 09:28:58 INFO [pg_query_executor] fetching from cursor x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14643343661038434741
2026/04/15 09:28:58 INFO processed row stream x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart cursor=peerdb_cursor_14643343661038434741 records=0 bytes=0 channelLen=0
2026/04/15 09:28:58 INFO [pg_query_executor] fetched rows x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id" rows=0 bytes=0 channelLen=0
2026/04/15 09:28:58 INFO [pg_query_executor] committing transaction x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart
2026/04/15 09:28:58 INFO [pg_query_executor] committed transaction for query x-peerdb-additional-metadata={Operation:FLOW_OPERATION_UNKNOWN} partitionId=testpart query="SELECT id,val FROM e2e_test_api_54z3ykyj.\"original\" ORDER BY id" rows=2 bytes=19 channelLen=0
--- FAIL: TestApiPg/TestEditTablesBeforeResync (42.21s)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@github-actions
Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: Both failing tests (TestApiMongo/TestCancelTableAddition_NoRemovalAssumed and TestApiMy/TestCancelTableAdditionRemoveAddRemove) hit FATAL: terminating connection due to administrator command (SQLSTATE 57P01), a transient PostgreSQL connection kill that is an infrastructure issue unrelated to the code change.
Confidence: 0.95

✅ Automatically retrying the workflow

View workflow run

@github-actions
Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: TestApiPg/TestEditTablesBeforeResync failed due to SQLSTATE 57P01 (admin_shutdown) — a transient PostgreSQL catalog connection termination in CI, not a code regression.
Confidence: 0.92

✅ Automatically retrying the workflow

View workflow run

@github-actions
Copy link
Copy Markdown
Contributor

🔄 Flaky Test Detected

Analysis: The test failed with PostgreSQL SQLSTATE 57P01 (admin_shutdown) — the CI Postgres connection was terminated by an external administrative command, which is an infrastructure-level transient error unrelated to any code change.
Confidence: 0.97

✅ Automatically retrying the workflow

View workflow run

@github-actions
Copy link
Copy Markdown
Contributor

🔄 Possible Flaky Test

Analysis: The e2e test suite failed in the mysql-gtid matrix job despite the triggering commit only touching pg-pg logic, and the failure logs show no specific assertion error — only a bare FAIL after 694s — suggesting a timing/infrastructure issue in the Temporal-based e2e environment rather than a code regression.
Confidence: 0.65

⚠️ Confidence too low (0.65) to retry automatically - manual review recommended

View workflow run

@jgao54 jgao54 merged commit 7ca6911 into main Apr 15, 2026
22 of 27 checks passed
@jgao54 jgao54 deleted the docdb-err branch April 15, 2026 17:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants