> ## Documentation Index
> Fetch the complete documentation index at: https://docs.zeotap.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Set Up a Databricks Source

> A step-by-step visual guide to creating a Databricks source in the Integrate module, covering both JDBC and Job-Based authentication types.

This guide walks you through the end-to-end process of creating a Databricks source in the Integrate module, from selecting the source category to verifying a successful integration. For detailed information about the underlying components and prerequisites, refer to [Create and Implement a Databricks Source](/articles/integrate-customer/create-and-implement-a-databricks-source).

## Step 1: Open the Sources Tab and Click Create Source

Navigate to **Integrate → Sources** in the Zeotap CDP App. Click **Create Source** in the top-right corner of the Sources listing page.

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step1-create-source-tab.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=dac15492934863acdc69822bce9a0a79" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step1-create-source-tab.png" />
</Frame>

## Step 2: Select Data Warehouse as the Category

In the **Create Source** dialog, you will be presented with a list of source categories. Select **Data Warehouse** to proceed with a Databricks source.

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step2-select-data-warehouse.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=053a87e4e9a5fd0bb7cc436032c4da08" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step2-select-data-warehouse.png" />
</Frame>

On the next screen, choose **Databricks** as the data source type.

## Step 3: Fill in Source Details

The **Source Details** step collects the configuration needed to connect to your Databricks workspace. Fill in the following fields:

* **Source Name** — Enter a short, descriptive name for the source.
* **Sequence** — Specify the sequence number for data ordering.
* **Sync Frequency** — Set how often data should be synchronised (for example, hourly, daily, or weekly).
* **Host** — Enter your Databricks workspace URL.
* **Catalog Name** — Provide the catalog that contains your target data.
* **Schema Name** — Specify the schema within the catalog.
* **Table Name** — Enter the name of the table to ingest.

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step3-configure-source-details.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=dc70b5feb94ab0a646cf6c509b73f77e" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step3-configure-source-details.png" />
</Frame>

* **Data Entity** — Choose whether you are ingesting **Customer Data** or **Non Customer Data**.
* **Delta Queries Selection** — Set to **true** if you want to fetch only new and updated records based on a timestamp column. Set to **false** to fetch all records on every run.

## Step 4: Choose the Connection Type and Authentication

Under **Type**, select the mechanism used to pull data from Databricks:

* **JDBC** — The standard connection method.
* **Job Based** — The recommended option for large data volumes.

<Note>
  **Note**

  If you are ingesting more than 1 million records, use the **Job Based** approach. JDBC may encounter performance issues with large data volumes.
</Note>

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step4-authentication-type.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=ed8f3a29b8b7b47e1f128b282c950419" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step4-authentication-type.png" />
</Frame>

After selecting the Type, choose the **Auth Type** from the dropdown. The available options differ depending on the connection type selected.

## Step 5: Configure JDBC Authentication

If you selected **JDBC**, enter the following credentials:

| Field                | Description                                                                                                            |
| :------------------- | :--------------------------------------------------------------------------------------------------------------------- |
| **Client ID**        | The OAuth client ID from your Databricks service principal.                                                            |
| **Client Secret**    | The OAuth client secret associated with your service principal.                                                        |
| **HTTP Path**        | The HTTP path of your Databricks SQL warehouse. Found under **SQL Warehouses → Connection details**.                   |
| **Partition Column** | Optional. A column used to split large datasets for parallel reads. Use a unique column if no partition column exists. |

For guidance on obtaining the Client ID, Client Secret, and HTTP Path, refer to the [Prerequisites for JDBC](/articles/integrate-customer/create-and-implement-a-databricks-source#prerequisites-for-jdbc-approach) section.

## Step 6: Configure Job-Based Authentication

If you selected **Job Based**, choose the **Auth Type** and enter the corresponding credentials:

**PACKTOKEN**

| Field          | Description                                                                                                                                |
| :------------- | :----------------------------------------------------------------------------------------------------------------------------------------- |
| **Pack Token** | A personal access token generated from your Databricks account. Navigate to **Settings → User Settings → Developer → Generate new token**. |

**Service Principal**

| Field             | Description                                              |
| :---------------- | :------------------------------------------------------- |
| **Client ID**     | The client ID of the Databricks service principal.       |
| **Client Secret** | The client secret associated with the service principal. |

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step5-jdbc-auth.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=59710ad29c88d454682e3f1bd8164432" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step5-jdbc-auth.png" />
</Frame>

<Warning>
  **Security notice**

  Keep all credentials — Client ID, Client Secret, and Pack Token — secure. Do not share them publicly or commit them to version control.
</Warning>

## Step 7: Finalise and Verify the Source

After entering all required fields, click **Next** to proceed to column selection. Select the columns you want to ingest, then click **Create Source**.

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step6-job-based-auth.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=9a300c84bee51866edbcb2d6426db5ca" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step6-job-based-auth.png" />
</Frame>

Once created, the source appears in the Sources listing page with a status of **Integrated**.

<Frame>
  <img src="https://mintcdn.com/zeotap/eruOOrzoSjga8a0u/articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step7-finalize.png?fit=max&auto=format&n=eruOOrzoSjga8a0u&q=85&s=483fe664fdff1d77b10be5a1d6d73a6f" width="1920" height="1000" data-path="articles/integrate-customer/Storage/integrate-customer/create-a-databricks-source/create-a-databricks-source-step7-finalize.png" />
</Frame>

<Note>
  **Note**

  The initial data transfer from Databricks to Zeotap CDP may take time depending on data volume. For assistance with Databricks source setup, contact the Zeotap support team at [support@zeotap.com](mailto:support@zeotap.com).
</Note>

## Related Topics

<CardGroup>
  <Card title="Create and Implement a Databricks Source" href="/articles/integrate-customer/create-and-implement-a-databricks-source" icon="angles-right" iconType="solid" horizontal={true} />

  <Card title="Create a Snowflake Source" href="/articles/integrate-customer/create-a-snowflake-source" icon="angles-right" iconType="solid" horizontal={true} />

  <Card title="Create a BigQuery Source" href="/articles/integrate-customer/create-a-bigquery-source" icon="angles-right" iconType="solid" horizontal={true} />
</CardGroup>
