Snap Pack history: Databricks
|
|
|
Updates |
|---|---|---|---|
|
|
|
Upgraded the Apache CXF client library dependency across Snap Packs to the latest stable patch version (3.6.12) as part of the routine maintenance fixes and performance improvements. This update strengthens platform security with no changes needed to existing pipeline configurations or Snap behaviors. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Added the Databricks - Execute Snap, modeled on other database Execute Snaps, to support batch execution.
|
|
|
|
|
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Enhanced the Databricks Account to support M2M authentication, allowing secure connections using a Client ID and Client secret. The basic authentication for Databricks using a username and password is no longer supported since July 10, 2024. |
|
|
|
Enhanced the following Databricks Snaps to support the Unity catalog that enables you to access catalog data from the database. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Upgraded the org.json.json library from v20090211 to
v20240303, which is fully backward compatible. |
|
|
|
Added Databricks - Run Job . This Snap executes a job, checks its status in Databricks, and, based on the job's status, completes or fails the pipeline. |
|
|
|
Fixed an invalid session handle issue with the Databricks Snap Pack that intermittently triggered an error message when the Snaps failed to connect with Databricks to execute the SQL statement. |
|
|
|
Updated the Delete Condition (Truncates a Table if empty) field in the Databricks - Delete Snap to Delete condition (deletes all records from a table if left blank) to indicate that all entries will be deleted from the table when this field is blank, but no truncate operation is performed. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Enhanced the performance of the Databricks - Insert Snap to improve the amount of time it takes for validation. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
The following fields are added to each Databricks Snap as part of this enhancement:
|
|
|
|
The Manage Queued Queries property in the Databricks Snap Pack enables you to decide whether a given Snap should continue or cancel executing the queued Databricks SQL queries. |
|
|
|
Updated and certified against the current SnapLogic Platform release. |
|
|
|
A new Snap Pack for Databricks Lakehouse Platform (Databricks or DLP)
introduces the following Snaps:
|