Skip to content

Upgrade SDK - to support discovery url on U2M (AWS and GCP flows) #1011

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
samikshya-db merged 7 commits into from
Sep 18, 2025
Merged

Upgrade SDK - to support discovery url on U2M (AWS and GCP flows) #1011

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
14f6941
Upgrade sdk
samikshya-db Sep 17, 2025
7779c4f
Merge branch 'main' into samikshya-chand_data/upgradesdk
samikshya-db Sep 17, 2025
5ffdbcb
Update NEXT_CHANGELOG.md
samikshya-db Sep 17, 2025
0f86589
Merge branch 'main' into samikshya-chand_data/upgradesdk
samikshya-db Sep 18, 2025
891fb30
release freeze update
samikshya-db Sep 18, 2025
94fee29
update branch
samikshya-db Sep 18, 2025
4777bbd
Merge branch 'main' into samikshya-chand_data/upgradesdk
samikshya-db Sep 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion NEXT_CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,10 @@
- Implement lazy/incremental fetching for columnar results when using Databricks JDBC in Thrift mode without Arrow support. The change modifies the behavior from buffering entire result sets in memory to maintaining only a limited number of rows at a time, reducing peak heap memory usage and preventing OutOfMemory errors.
- Added new artifact `databricks-jdbc-thin` for thin jar with runtime dependency metadata.
- Introduce a memory-efficient columnar data access mechanism for JDBC result processing.
- Added support for using a custom Discovery URL in U2M flows on AWS and GCP.

### Updated
- Databricks SDK dependency upgraded to latest version 0.60.0
- Databricks SDK dependency upgraded to latest version 0.64.0
- Updated the default value of RowsFetchedPerBlock to 100K from 2M to capture typical cases and balance memory usage.

### Fixed
Expand Down
2 changes: 1 addition & 1 deletion development/.release-freeze.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"freeze": true,
"reason": "Releasing JDBC - 16th Sep",
"allow_list": ["jayantsing-db/default-max-rows-per-block", "ResultSetMetadataFix", "PECOBLR-951"]
"allow_list": ["samikshya-chand_data/upgradesdk"]
}
2 changes: 1 addition & 1 deletion pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@
<httpclient.version>4.5.14</httpclient.version>
<commons-configuration.version>2.10.1</commons-configuration.version>
<commons-io.version>2.14.0</commons-io.version>
<databricks-sdk.version>0.60.0</databricks-sdk.version>
<databricks-sdk.version>0.64.0</databricks-sdk.version>
<maven-surefire-plugin.version>3.1.2</maven-surefire-plugin.version>
<sql-logic-test.version>0.3</sql-logic-test.version>
<lz4-compression.version>1.8.0</lz4-compression.version>
Expand Down
Loading