Run push-to-main integration tests in short mode by pietern · Pull Request #5644 · databricks/cli

pietern · 2026-06-18T12:59:10Z

Commits to main currently dispatch cli-isolated-nightly.yml, which runs the full integration suite including the slow CloudSlow cloud tests (vector search indexes, Lakebase, model serving, app runs, wheel integration). Those routinely overflow the 2h test-binary budget and time out, putting spurious red X's on main commits.

This points the push-to-main trigger at cli-isolated-pr.yml instead, which runs in short mode (-short), so CloudSlow tests skip themselves. Commits to main now get fast, reliable signal. The full CloudSlow suite still runs on the nightly schedule and on workflow-file changes — just not on every commit.

This pull request and its description were written by Isaac.

Point the push-to-main trigger at cli-isolated-pr.yml (which passes short: true) instead of cli-isolated-nightly.yml. Commits to main now skip the slow CloudSlow cloud tests, giving fast, reliable signal. The full CloudSlow suite runs only on the nightly schedule and on workflow-file changes, not on every commit. Co-authored-by: Isaac

eng-dev-ecosystem-bot · 2026-06-18T13:22:51Z

Integration test report

Commit: 528a9fa

Run: 27761197853

	Env	❌FAIL	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux				7	13	264	1011	5:06
💚	aws windows				7	13	266	1009	7:56
💚	aws-ucws linux				7	13	360	925	5:51
💚	aws-ucws windows				7	13	362	923	8:11
💚	azure linux				1	15	267	1009	5:14
💚	azure windows				1	15	269	1007	7:02
🔄	azure-ucws linux			3		15	363	921	7:13
💚	azure-ucws windows				1	15	367	919	8:20
❌	gcp linux	236	1			15	25	1001	0:53
❌	gcp windows	238	1			15	25	999	1:36

258 interesting tests: 238 FAIL, 13 SKIP, 6 RECOVERED, 1 KNOWN

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	🟨K	🟨K
❌	TestAccept/bundle/deploy/files/no-snapshot-sync	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deploy/files/no-snapshot-sync/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deploy/mlops-stacks	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	❌F	❌F
❌	TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/alert	🙈s	🙈s	🙈s	🙈s	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=direct					✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/alert/DATABRICKS_BUNDLE_ENGINE=terraform					✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/deployment/bind/job/generate-and-bind/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/destroy/jobs-and-pipeline	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/destroy/jobs-and-pipeline/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/destroy/jobs-and-pipeline/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/generate/alert	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/generate/auto-bind	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/generate/auto-bind/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
❌	TestAccept/bundle/resources/alerts/with_file	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/apps/inline_config	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/dashboards/generate_inplace	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/dashboards/generate_inplace/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/dashboards/generate_inplace/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/check-metadata	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/check-metadata/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/check-metadata/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/shared-root-path	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/shared-root-path/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/resources/jobs/shared-root-path/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/replace_existing	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_projects/update_display_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
❌	TestAccept/bundle/run_as/job_default	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/bundle/run_as/job_default/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/basic	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/basic/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/basic/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/error	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/error/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/error/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/pipeline-crud	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/pipeline-crud/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/pipeline-crud/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/workspace-file-io	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/workspace-file-io/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAccept/selftest/record_cloud/workspace-file-io/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
❌	TestDashboardAssumptions_WorkspaceImport	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestBundleInitErrorOnUnknownFields	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestBundleInitHelpers	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAlertsCreateErrWhenNoArguments	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestApiGet	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestAuthDescribeSuccess	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestClustersGet	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestClustersList	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCat	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCat/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatDoesNotSupportOutputModeJson	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatForDbfsInvalidScheme	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatOnADir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatOnADir/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatOnNonExistentFile	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCatOnNonExistentFile/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCompletion	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDir/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDir/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDir/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpDir/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDir/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirFileNotOverwritten/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpDirToDirWithOverwriteFlag/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpErrorsOnInvalidScheme	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpErrorsWhenSourceIsDirWithoutRecursiveFlag	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpErrorsWhenSourceIsDirWithoutRecursiveFlag/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDir/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirFileNotOverwritten/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirForWindowsPaths	🙈s	✅p	🙈s	✅p	🙈s	✅p	🙈s	✅p	🙈s	❌F
❌	TestFsCpFileToDirWithOverwriteFlag	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirWithOverwriteFlag/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirWithOverwriteFlag/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirWithOverwriteFlag/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirWithOverwriteFlag/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToDirWithOverwriteFlag/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFile/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileFileNotOverwritten/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToFileWithOverwriteFlag/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDir/local_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpFileToNonExistentDirWindowsPaths	🙈s	✅p	🙈s	✅p	🙈s	✅p	🙈s	✅p	🙈s	❌F
❌	TestFsCpSourceIsDirectoryButTargetIsFile	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpSourceIsDirectoryButTargetIsFile/dbfs_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpSourceIsDirectoryButTargetIsFile/dbfs_to_local	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsCpSourceIsDirectoryButTargetIsFile/dbfs_to_uc-volumes	🙈s	🙈s	✅p	✅p	🙈s	🙈s	✅p	✅p	❌F	❌F
❌	TestFsCpSourceIsDirectoryButTargetIsFile/local_to_dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLs/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsForNonexistingDir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsForNonexistingDir/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsOnEmptyDir	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsOnEmptyDir/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsOnFile	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F
❌	TestFsLsOnFile/dbfs	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	❌F	❌F

Top 17 slowest tests (at least 2 minutes):

duration	env	testname
3:39	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:32	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:30	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:29	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:24	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:23	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:14	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:12	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:55	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:45	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:42	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:41	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:36	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:34	azure-ucws windows	TestAccept
2:32	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:31	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:27	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

(94 table rows omitted to keep the report under 60000 bytes)

eng-dev-ecosystem-bot · 2026-06-18T13:52:05Z

Integration test report

Commit: 179c38c

Run: 27762715478

	Env	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
💚	aws linux	7	13	264	1011	5:00
💚	aws windows	7	13	266	1009	7:24
💚	aws-ucws linux	7	13	360	925	6:11
💚	aws-ucws windows	7	13	362	923	7:59
💚	azure linux	1	15	267	1009	5:21
💚	azure windows	1	15	269	1007	6:36
💚	azure-ucws linux	1	15	365	921	6:20
💚	azure-ucws windows	1	15	367	919	8:00
💚	gcp linux	1	15	263	1012	5:54
💚	gcp windows	1	15	265	1010	7:49

20 interesting tests: 13 SKIP, 7 RECOVERED

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
💚	TestAccept	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	💚R	💚R	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/replace_existing	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_projects/update_display_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S

Top 20 slowest tests (at least 2 minutes):

duration	env	testname
5:01	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:19	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:00	gcp windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:59	gcp linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:35	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:20	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:11	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:07	aws-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:04	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:03	aws-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:02	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:50	aws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:47	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:44	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:42	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:42	azure-ucws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:37	azure-ucws windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:34	azure windows	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:33	aws linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:32	azure linux	TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

denik · 2026-06-19T19:51:08Z

This points the push-to-main trigger at cli-isolated-pr.yml instead, which runs in short mode (-short), so CloudSlow tests skip themselves.

Besides adding -short it also adds DATABRICKS_TEST_SKIPLOCAL=1, which skips most of the tests. We should probably rename the target in Taskfile to make it obvious that it's not just short: integration-short-skiplocal or integration-very-very-short.

  integration-short:
    desc: Run short integration tests
    deps: [install-pythons]
    cmds:
      - |
        DATABRICKS_TEST_SKIPLOCAL=1 VERBOSE_TEST=1 \
        go run -modfile=tools/go.mod ./tools/testrunner/main.go \
          {{.GO_TOOL}} gotestsum \
          --format github-actions \
          --rerun-fails \
          --jsonfile output.json \
          --packages "./acceptance ./integration/..." \
          -- -parallel 4 -timeout=2h -short

pietern requested review from andrewnester and shreyas-goenka June 18, 2026 12:59

pietern temporarily deployed to test-trigger-is June 18, 2026 12:59 — with GitHub Actions Inactive

andrewnester approved these changes Jun 18, 2026

View reviewed changes

pietern merged commit 179c38c into main Jun 18, 2026
24 of 25 checks passed

pietern deleted the deflake/push-main-short branch June 18, 2026 13:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Run push-to-main integration tests in short mode#5644

Run push-to-main integration tests in short mode#5644
pietern merged 1 commit into
mainfrom
deflake/push-main-short

pietern commented Jun 18, 2026

Uh oh!

eng-dev-ecosystem-bot commented Jun 18, 2026

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jun 18, 2026

Uh oh!

denik commented Jun 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

pietern commented Jun 18, 2026

Uh oh!

eng-dev-ecosystem-bot commented Jun 18, 2026

Integration test report

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jun 18, 2026

Integration test report

Uh oh!

denik commented Jun 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants