Configure a Databricks Delta Share Data Connection (Hybrid Pattern)
LiveRamp Clean Room’s application layer enables companies to securely connect distributed datasets with full control and flexibility while protecting the privacy of consumers and the rights of data owners.
To configure a Databricks Delta Share (hybrid pattern) data connection, see the instructions below.
Note
This data connection is used to enable Databricks data connections for Hybrid pattern. For information on Databricks data connections for Databricks pattern, see "Configure a Databricks Pattern Data Connection".
Overall Steps
Perform the following overall steps to configure a Databricks Delta Share data connection in LiveRamp Clean Room:
For information on performing these steps, see the sections below.
Download Credentials from Databricks
Configure a Delta Share for use in enabling LiveRamp Clean Room to orchestrate access to your Databricks table in your Hybrid Clean Rooms:
Go to your Catalog Explorer in Databricks, find the table you wish to share, and select "Share via Delta Sharing'.
Select "Create a new share with the Table" and apply a new Share name.
Click .
Find the newly created share in your "Shares" screen and select the "Recipients" tab.
Create a new recipient for use with clean rooms.
Go to this recipient in your Catalog and capture the "Activation link" value. Click the link and you will be taken to download a credential file.
Download and copy the JSON credential in the credential file.
Note
You may use these credentials for all Delta Table shares to LiveRamp Clean Room. Each table will have its own data connection, leveraging the same credentials.
Add the Credentials
After you've downloaded the credentials from Databricks, add the credentials to LiveRamp Clean Room:
From the LiveRamp Clean Room navigation pane, select Data Management → Credentials.
Click .
Enter a descriptive name for the credential and then select "Databricks Delta Credentials" for the Credentials Type.
Enter the JSON credential you downloaded in the previous step to the Sharing ID field.
Click .
Create a Data Connection
After you've added the credentials to LiveRamp Clean Room, create the data connection:
From the LiveRamp Clean Room navigation pane, select Data Management → Data Connections.
From the Data Connections page, click .
From the New Data Connection screen, select "Databricks Delta Table Connection".
Configure the data connection:
Name: Enter a name of your choice.
Category: Enter a category of your choice.
Dataset Type: Select Generic.
Delta Share Name: Enter the name of the share you created in the earlier step.
Delta Schema Name: Enter the name of the schema for the table you shared.
Delta Table Name: Enter the name of the table you shared.
Review the data connection details and click .
All configured data connections can be seen on the Data Connections page.
When a connection is initially configured, it will show "Verifying Access" as the configuration status. Once the connection is confirmed and the status has changed to "Mapping Required", map the table's fields.
Map the Fields
Once the connection is confirmed and the status has changed to "Mapping Required", map the table's fields and add metadata:
From the row for the newly-created data connection, click the More Options menu (the three dots) and then click .
The Map Fields screen opens and the file column names auto-populate.
For any columns that you do not want to be queryable, slide the Include toggle to the left.
If needed, update any column labels.
Note
Ignore the field delimiter fields because this was defined in a previous step.
Click .
The Add Metadata screen opens.
For any column that contains PII data, slide the PII toggle to the right.
Select the data type for each column.
If a column contains PII, slide the User Identifiers toggle to the right and then select the user identifier that defines the PII data.
Click .
Your data connection configuration is now complete and the status changes to "Completed".