Databricks

Connect Foundry to Databricks to read and sync data between Databricks and Foundry.

Supported capabilities

Capability	Status
Exploration	🟢 Generally available
Bulk import	🟢 Generally available
Incremental	🟢 Generally available

Setup

Open the Data Connection application and select + New Source in the upper right corner of the screen.
Select Databricks from the available connector types.
Choose to use a direct connection over the Internet or to connect through an intermediary agent.
Follow the additional configuration prompts to continue the setup of your connector using the information in the sections below.

Learn more about setting up a connector in Foundry.

Configuration options

The following configuration options are available for the Databricks connector:

Option	Required?	Description
`Hostname`	Yes	The Databricks compute resource’s Server Hostname value.
`HTTP Path`	Yes	The Databricks compute resource’s HTTP Path value.

Please refer to the official Databricks documentation ↗ for information on how to obtain these values.

Authentication

You can authenticate with Databricks in the following ways:

Personal access token: Uses a personal access token to authenticate as a Databricks user. Learn more in the official Databricks documentation ↗.
OAuth machine-to-machine (M2M): Uses a client ID and secret to authenticate as a Databricks service principal. Learn more in the official Databricks documentation ↗.
Basic: Uses the username and password to authenticate as a Databricks user. Basic authentication is legacy and not recommended in production. Learn more in the official Databricks documentation ↗.

Networking

The Databricks connector requires network access to the Hostname provided in Configuration options on port 443. If you are using a direct connection through the internet, ensure that an egress policy exists. For agent runtimes, the server running the agent must have network access to this domain.