Create a Databricks connection

Establish a zero copy connection to the Databricks data analytics platform in Workflow Data Fabric Hub.

Before you begin

You can optimize queries to Databricks by enabling table statistics. Consult your data source admin to confirm whether table statistics are enabled in Databricks before enabling this option in Workflow Data Fabric Hub.

Role required: df_connection_admin

About this task

Work with your data source admin to create a connection to Databricks. For additional information about connecting to Databricks, refer to the Databricks documentation.

Procedure

1. Navigate to the available primary connectors in Workflow Data Fabric Hub in one of the following ways:
   • Navigate to All > Workflow Data Fabric Hub > Available connectors > Primary connectors.
   • Navigate to Admin > Workflow Data Fabric Hub > Available connectors > Primary connectors.
2. Find the Databricks connector and select Connect.
3. On the form, fill in the fields.

   Table 1. New Databricks Connection form

   Field	Description
   Name and description
   Connection label	Unique name for this connection. This helps in identifying the connection within your system.
   Connection name	System-generated name based on the Connection label. This field cannot be modified once the connection is established.
   Short description	Description of the connection explaining what it is about.
   Connection attributes
   Catalog name	Catalog name used for organizing and locating data assets in Databricks.
   Connection URL	JDBC URL to establish the connection. For example: jdbc:databricks://<host>:<port>
   Warehouse or compute path	Databricks warehouse or compute path. For example: /sql/1.0/warehouses/
   Enable table statistics	Option to enable table statistics. Optimize SQL queries using table statistics by selecting this option. Enabling table statistics allows the system to use estimates of stored data such as row count, distinct values, and data size for enhanced query processing. Note: You must ensure that gathering table statistics is enabled in the data source before selecting this option.
   Authentication method
   OAuth client ID	Client ID issued by Databricks for authentication.
   OAuth secret	Secret key associated with the client ID.

4. Select Connect.

Result

A test connection is made to the external data source, verifying that the connection details are correct and the data source is accessible.

What to do next

If the connection succeeds, configure data steward access on the Access Control tab. See Manage access to an established connection using roles.

If the connection fails, verify the connection details with your data source administrator and try again.