Skip to main content

Export Analytical Results to BigQuery

You can set up an export of analytics results to BigQuery for the following clean room types:

  • Snowflake

  • Hybrid

  • Confidential Computing

  • Walled Garden (ADH, AMC, and FAA)

Note

  • List question results cannot be exported to BigQuery.

  • Make sure that the bucket path you use for the export destination is distinct from any bucket paths you use for existing BigQuery data connections in LiveRamp Clean Room. For example, to use the same bucket for both exports and data connections, make sure to use a distinct folder in that bucket for exports and a distinct folder for each data connection.

  • Partners invited to a clean room must have their export destination connections (grouped under "Destinations") approved by clean room owners. Contact your Customer Success representative to facilitate the approval.

  • The IAM role from LiveRamp Clean Room needs to have write/delete and read access on the customer bucket/folder.

  • Configuring exports outside of a clean room (such as at the organization level) is still supported, but will be deprecated. Setting up clean room question exports within a clean room is recommended.

Overall Steps

Perform the following overall steps to set up an export of analytics results to BigQuery:

  1. Enable the clean room for exports.

  2. Add the credentials.

  3. Add an export destination connection.

  4. For exports from a Snowflake clean room, configure the question to share the question results with LiveRamp.

  5. Provision the destination connection to the clean room.

  6. Create a new export

For information on performing these steps, see the sections below.

Enable the Clean Room for Exports

Before setting up an export, the clean room owner must enable exports for the selected source clean room (if not already done during clean room creation):

  1. From the navigation menu, select Clean Room → Clean Rooms to open the Clean Rooms page.

    LCR-Old_Clean_Room_Nav_menu.png

  2. In the row for the clean room you would like to export from, click the More Options menu (the three dots), and then select Edit.

    CR-Export_to_GCS-edit_button.png

  3. From the Configuration step, click Next Step.

    LCR-Export_Analytical_Results_to_BigQuery-Next_Step_button.png

  4. From the Parameters step, adjust any data control parameters as needed and then slide the Enable Export toggle to the right.

    CR-Export_to_GCS-edit_clean_room_screen.png

  5. Click Next Step.

  6. Verify that your data control parameters are correct and then click Save.

    CR-Export_to_GCS-edit_clean_room_screen_2.png

Add the Credentials

After enabling the clean room for exports, the clean room owner must first add either their own credentials or those of their partner:

  1. From the navigation menu, select Clean Room → Credentials to open the Credentials page.

  2. Click Create Credential.

    add_credential.png

  3. Enter a descriptive name for the credential.

  4. For the Credentials Type, select "Google Service Account".

    CR-Export_to_GCS-edit_credential.png

  5. For the Project ID, enter the project ID.

  6. Enter your Credential JSON (credential JSON is hidden by default, viewable here for demonstration purposes).

    CR-Export_to_GCS-_credential_JSON.png

  7. Click Save Credential.

  8. Verify that your credentials have been added to LiveRamp Clean Room:

    CR-Export_to_GCS-_verify_credential.png

Add an Export Destination Connection

To create an export destination connection:

  1. From the navigation menu, select Clean Room → Destinations to open the Destinations page.

    LCR-Old_Destinations_Nav_menu.png

  2. Click Create Destination Connection.

    image idm2060

  3. Select BigQuery Export.

    CR-Export_to_BQ-choose_account.png

  4. Enter a name and select the BigQuery Credential created in the "Add the Credentials" section above.

    CR-Export_to_BQ-_choose_credential.png

  5. Click Add new account.

  6. Confirm that the new export has been added to your list of GCS export destination accounts.

    CR-Export_to_GCS-_confirm_export.png

Note

The status of the destination connection will initially be "Configured", but you can continue to export data. Once the first successful export has been processed, the status changes to "Complete".

Configure the Question to Share Results

For exports to BigQuery from a Snowflake clean room, you need to configure the question to share the results from your Snowflake account to LiveRamp:

Note

This step does not have to be performed if you’re exporting a question from a Walled Garden (ADH, AMC, and FAA) clean room.

  1. From the navigation menu, select Clean Room → Clean Rooms to open the Clean Rooms page.

    LCR-Old_Clean_Room_Nav_menu.png

  2. From the tile for the desired clean room, click Enter.

  3. From the Clean Room navigation pane, select Questions.

  4. In the row for the question whose results you want to export, click the More Options menu and then select Share Question Results.

    LCR-Export_AWS-Share_Question_Results_menu_selection.png

  5. From the dialog that appears, make sure that the check box for LiveRamp is checked and then click Share.

    LCR-Export_AWS-Share_button.png

Provision a Destination Connection to the Clean Room

Once you've created a destination connection, you can provision that destination connection to the clean room you want to export results from:

Note

In most situations, only the clean room owner can provision export destinations using this method. To give clean room partners the ability to provision destinations that the owner has created, contact your LiveRamp representative.

  1. From the navigation menu, select Clean Room → Clean Rooms to open the Clean Rooms page.

    LCR-Old_Clean_Room_Nav_menu.png

  2. From the Clean Room navigation pane, select Destinations. The Destinations screen shows all destination connections provisioned to the clean room.

  3. Click Provision Destination.

    cr_activation_provision.png

  4. Check the check box for the desired destination connection and then click Provision (AWS S3 example shown).

    CR-Export_to_AWS-_provision_Activation_Channels.png

  5. Verify that your destination connection has been added (S3 IAM example shown).

    CR-Export_to_AWS-_verify_Activation_Channels.png

    Note

    If you're a clean room partner who has been given the ability to request the provisioning of export destinations, the status will show as "Configured (Pending Approval)" until the clean room owner has approved the provisioning of the destination. You can still set up your exports, but the data will not be exported until the request has been approved.

Approve a Destination Provisioning Request

If you're a clean room owner, you're clean room partners can provision export destinations in the clean room, but the status will show as "Configured (Pending Approval)" until you have approved the provisioning of the destination.

To approve the provisioning request:

  1. From the navigation menu, select Clean Room → Clean Rooms to open the Clean Rooms page.

    LCR-Old_Clean_Room_Nav_menu.png

  2. From the Clean Room navigation pane, select Destinations. The Destinations screen shows all destination connections provisioned to the clean room.

  3. Click the caret next to the destination type to view the list of destination connections for that destination type.

  4. For the destinations that show the status as "Configured (Pending Approval)", click Approve.

    LCR-Approve_destination_provision.png

The destination status changes to "Configured".

Create a New Export

After you've provisioned the destination connection to the clean room, create a new export:

  1. From the LiveRamp Clean Room navigation pane, select Clean Rooms → Clean Rooms.

  2. From the tile for the desired clean room, click Enter.

  3. From the Clean Room navigation pane, select Exports.

  4. Click + New to open the wizard to create a new export.

    CR-Export_to_GCS-__Exports_page.png

  5. Select the question that you want to export outputs for and then click Next.

    CR-Export_to_GCS-_choose_clean_room_question.png

  6. Select the specific BigQuery Export destination account you want to send run outputs to.

    CR-Export_to_BQ-_choose_export_channel.png

  7. Enter the dataset name and table name for the table runs should be added to and then click Finish.

    CR-Export_to_BQ-_configure_folder.png

  8. Verify that the job has been created. Exports are added to the page. You may view the details of an export by clicking on the name.

    CR-Export_to_BQ-_verify_job.png
    CR-Export_to_BQ-_verify_job_2.png

Note

  • Exports can be paused, which will stop them from sending data upon the completion of each run.

  • Exports cannot be edited or deleted. Changes should be made by pausing the export and creating a new export.

Export Details

When a question runs, the results will be written to the defined table. Each row will have an associated "Run ID" column. There will be a second metadata table created.

In this section: