[PLUGIN-1954] Update Snowflake JDBC driver to 4.0.2 and adapt API changes#60
[PLUGIN-1954] Update Snowflake JDBC driver to 4.0.2 and adapt API changes#60harishhk107 wants to merge 1 commit intodata-integrations:developfrom
Conversation
| try (Connection connection = dataSource.getConnection()) { | ||
| connection.unwrap(SnowflakeConnection.class).uploadStream(stageDir, | ||
| null, | ||
| inputStream, filename, true); |
There was a problem hiding this comment.
why filename is removed, will it work without this
There was a problem hiding this comment.
The legacy 5-argument uploadStream method with positional booleans was deprecated/removed in the 4.x driver. Migrating to the UploadStreamConfig builder explicitly handles the compression and destination prefix, making the implementation compatible with the new API
| try (Connection connection = dataSource.getConnection()) { | ||
| InputStream downloadStream = connection.unwrap(SnowflakeConnection.class) | ||
| .downloadStream("@~", stageSplit, true); | ||
| .downloadStream("@~", stageSplit, null); |
There was a problem hiding this comment.
what is the significance of this flag?
There was a problem hiding this comment.
In the Snowflake JDBC 4.x driver, the legacy positional method downloadStream(String, String, boolean) has been replaced by a more explicit signature that uses the DownloadStreamConfig object.
The 'true' flag significance: -> In the original code, true was the decompress flag. This tells the driver that the file stored on the Snowflake stage is compressed (e.g., GZIP) and should be automatically decompressed by the driver before returning the InputStream to the application
harishhk107
changed the title
Bumps `snowflake-jdbc.version` from `3.14.4` to `4.0.2`.
harishhk107
force-pushed
the
fix/key-pair-passphrase
branch
from
c86a112 to
28575e8
Compare
itsankit-google
left a comment
itsankit-google
left a comment
There was a problem hiding this comment.
Are these changes backward compatible?
What happens if an existing pipeline gets upgraded? Does it work seemlessly?
Have we tested that?
The v4.x driver includes a legacy wrapper for the previous driver class, so existing connection logic remains backward compatible. We have successfully tested the upgrade with our current pipelines, and they continued to run seamlessly without code changes. |
3 participants
PLUGIN-1954
Bumps
snowflake-jdbc.versionfrom3.14.4to4.0.2.The migration to Snowflake JDBC 4.0.2 requires updating downloadStream and uploadStream calls to use the new DownloadStreamConfig and UploadStreamConfig builders
Download Stream: Explicit Decompression
Previously, the decompression behavior was controlled by a trailing boolean. This is now encapsulated within
DownloadStreamConfig.Upload Stream: Encapsulated Configuration
The legacy 5-argument
uploadStreamhas been simplified. Metadata like destination prefixes and compression settings are now moved intoUploadStreamConfig.OAuth2 Authentication Update
-- Removed deprecated setOauthToken() method
-- Added explicit setAuthenticator("oauth") call before setting password
Configuration Validation Enhancement
-- Added passphrase validation for key-pair authentication
https://docs.snowflake.com/en/developer-guide/jdbc/jdbc-migration#stream-upload-and-download-changes