roachtest: cluster_creation failed

[cockroach-teamcity]

roachtest.cluster_creation failed with artifacts on release-25.2 @ b29b38600438cd4ac63e5be0aba7bf9da5ddbfa9:

test restore/tpce/15GB/aws/nodes=4/cpus=8 failed: (test_runner.go:840).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type m6i.2xlarge --image-id ami-0e83be366243f524a --key-name teamcity-runner-UkVSIXbA8bQzQ4eF9VuaJRE8a9E= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=roachtest-branch,Value=release-25-2},{Key=usage,Value=roachtest},{Key=Name,Value=teamcity-21402186-1782452470-53-n4cpu8-0001},{Key=Cluster,Value=teamcity-21402186-1782452470-53-n4cpu8},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-53-n4cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=created,Value=2026-06-26T06:47:16Z}] ResourceType=volume,Tags=[{Key=roachtest-branch,Value=release-25-2},{Key=usage,Value=roachtest},{Key=Name,Value=teamcity-21402186-1782452470-53-n4cpu8-0001},{Key=Cluster,Value=teamcity-21402186-1782452470-53-n4cpu8},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-53-n4cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=created,Value=2026-06-26T06:47:16Z}] --user-data file:///tmp/aws-startup-script2302958256 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping4234666871 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr: 
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): We currently do not have sufficient m6i.2xlarge capacity in the Availability Zone you requested (us-east-2a). Our system will be working on provisioning additional capacity. You can currently get m6i.2xlarge capacity by not specifying an Availability Zone in your request or choosing us-east-2b, us-east-2c.: exit status 254 [owner=test-eng]

Parameters:

• cloud=aws
• coverageBuild=false
• cpu=8
• diskCount=0
• runtimeAssertionsBuild=false

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: cluster_creation failed #171624 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.6-rc]
• roachtest: cluster_creation failed #171623 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.4.12-rc]
• roachtest: cluster_creation failed #171620 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.20-rc]
• roachtest: cluster_creation failed #171526 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.30-rc]
• roachtest: cluster_creation failed #171104 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1]
• roachtest: cluster_creation failed #170429 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.5-rc]

/cc @cockroachlabs/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-65158

[blathers-crl]

cc @cockroachdb/test-eng

[cockroach-teamcity]

roachtest.cluster_creation failed with artifacts on release-25.2 @ b29b38600438cd4ac63e5be0aba7bf9da5ddbfa9:

test restore/tpce/400GB/aws/inc-count=48/nodes=4/cpus=8 failed: (test_runner.go:840).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type m7g.2xlarge --image-id ami-05983a09f7dc1c18f --key-name teamcity-runner-UkVSIXbA8bQzQ4eF9VuaJRE8a9E= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-56-n4cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T06:49:40Z},{Key=Name,Value=teamcity-21402186-1782452470-56-n4cpu8-0001},{Key=Cluster,Value=teamcity-21402186-1782452470-56-n4cpu8},{Key=spot,Value=true}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-56-n4cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T06:49:40Z},{Key=Name,Value=teamcity-21402186-1782452470-56-n4cpu8-0001},{Key=Cluster,Value=teamcity-21402186-1782452470-56-n4cpu8},{Key=spot,Value=true}] --user-data file:///tmp/aws-startup-script4161292489 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping700713612 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr: 
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): We currently do not have sufficient m7g.2xlarge capacity in the Availability Zone you requested (us-east-2a). Our system will be working on provisioning additional capacity. You can currently get m7g.2xlarge capacity by not specifying an Availability Zone in your request or choosing us-east-2b, us-east-2c.: exit status 254 [owner=test-eng]

Parameters:

• cloud=aws
• coverageBuild=false
• cpu=8
• diskCount=0
• runtimeAssertionsBuild=false

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: cluster_creation failed #171624 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.6-rc]
• roachtest: cluster_creation failed #171623 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.4.12-rc]
• roachtest: cluster_creation failed #171620 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.20-rc]
• roachtest: cluster_creation failed #171526 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.30-rc]
• roachtest: cluster_creation failed #171104 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1]
• roachtest: cluster_creation failed #170429 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.5-rc]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.cluster_creation failed with artifacts on release-25.2 @ b29b38600438cd4ac63e5be0aba7bf9da5ddbfa9:

test ycsb/A/nodes=3/cpu=32/isolation-level=read-committed failed: (test_runner.go:840).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c7g.8xlarge --image-id ami-05983a09f7dc1c18f --key-name teamcity-runner-UkVSIXbA8bQzQ4eF9VuaJRE8a9E= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-70-n4cpu32},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T07:08:04Z},{Key=Name,Value=teamcity-21402186-1782452470-70-n4cpu32-0004},{Key=Cluster,Value=teamcity-21402186-1782452470-70-n4cpu32}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-70-n4cpu32},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T07:08:04Z},{Key=Name,Value=teamcity-21402186-1782452470-70-n4cpu32-0004},{Key=Cluster,Value=teamcity-21402186-1782452470-70-n4cpu32}] --user-data file:///tmp/aws-startup-script48137696 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping1830125905 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr: 
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): We currently do not have sufficient c7g.8xlarge capacity in the Availability Zone you requested (us-east-2a). Our system will be working on provisioning additional capacity. You can currently get c7g.8xlarge capacity by not specifying an Availability Zone in your request or choosing us-east-2b, us-east-2c.: exit status 254 [owner=test-eng]

Parameters:

• cloud=aws
• coverageBuild=false
• cpu=32
• diskCount=0
• runtimeAssertionsBuild=false

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: cluster_creation failed #171624 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.6-rc]
• roachtest: cluster_creation failed #171623 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.4.12-rc]
• roachtest: cluster_creation failed #171620 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.20-rc]
• roachtest: cluster_creation failed #171526 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.30-rc]
• roachtest: cluster_creation failed #171104 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1]
• roachtest: cluster_creation failed #170429 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.5-rc]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.cluster_creation failed with artifacts on release-25.2 @ b29b38600438cd4ac63e5be0aba7bf9da5ddbfa9:

test ycsb/A/nodes=3/cpu=32/mvcc-range-keys=global failed: (test_runner.go:840).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c7g.8xlarge --image-id ami-05983a09f7dc1c18f --key-name teamcity-runner-UkVSIXbA8bQzQ4eF9VuaJRE8a9E= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T07:11:01Z},{Key=Name,Value=teamcity-21402186-1782452470-73-n4cpu32-0004},{Key=Cluster,Value=teamcity-21402186-1782452470-73-n4cpu32},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-73-n4cpu32},{Key=lifetime,Value=12h0m0s}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=arch,Value=arm64},{Key=created,Value=2026-06-26T07:11:01Z},{Key=Name,Value=teamcity-21402186-1782452470-73-n4cpu32-0004},{Key=Cluster,Value=teamcity-21402186-1782452470-73-n4cpu32},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-21402186-1782452470-73-n4cpu32},{Key=lifetime,Value=12h0m0s}] --user-data file:///tmp/aws-startup-script2777709835 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping3297890541 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr: 
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): We currently do not have sufficient c7g.8xlarge capacity in the Availability Zone you requested (us-east-2a). Our system will be working on provisioning additional capacity. You can currently get c7g.8xlarge capacity by not specifying an Availability Zone in your request or choosing us-east-2b, us-east-2c.: exit status 254 [owner=test-eng]

Parameters:

• cloud=aws
• coverageBuild=false
• cpu=32
• diskCount=0
• runtimeAssertionsBuild=false

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: cluster_creation failed #171624 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.6-rc]
• roachtest: cluster_creation failed #171623 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.4.12-rc]
• roachtest: cluster_creation failed #171620 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.20-rc]
• roachtest: cluster_creation failed #171526 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.30-rc]
• roachtest: cluster_creation failed #171104 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1]
• roachtest: cluster_creation failed #170429 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.1.5-rc]

This test on roachdash | Improve this report!