Skip to main content

Export Analytical Results to BigQuery

You can set up an export of analytics results to BigQuery for the following clean room types:

  • Snowflake

  • Walled Garden (ADH, AMC, and FAA)

Exporting results to BigQuery has the overall steps shown below.

Note

  • List question results cannot be exported to BigQuery.

  • Make sure that the bucket path you use for the export destination is distinct from any bucket paths you use for existing BigQuery data connections in LiveRamp Clean Room. For example, to use the same bucket for both exports and data connections, make sure to use a distinct folder in that bucket for exports and a distinct folder for each data connection.

  • Partners invited to a clean room must have their export destination connections (grouped under "Destinations") approved by clean room owners. Contact your Customer Success representative to facilitate the approval.

  • The IAM role from LiveRamp Clean Room needs to have write/delete and read access on the customer bucket/folder.

  • Configuring exports outside of a clean room (such as at the organization level) is still supported, but will be deprecated. Setting up clean room question exports within a clean room is recommended.

Overall Steps

Perform the following overall steps set up an export of analytics results to BigQuery:

  1. Enable the clean room for exports.

  2. Add the credentials.

  3. Add an export destination connection.

  4. For exports from a Snowflake clean room, configure the question to share the question results with LiveRamp.

  5. Set up a data export within the clean room

  6. Create a new export

For information on performing these steps, see the sections below.

Enable the Clean Room for Exports

Before setting up an export, the clean room owner must enable exports for the selected source clean room:

  1. From the LiveRamp Clean Room navigation pane, select Clean Rooms → Clean Rooms (or click Go to Clean Rooms from the Clean Rooms tile).

  2. In the row for the clean room you would like to export from, click the More Options menu (the three dots), and then select Edit.

    CR-Export_to_GCS-edit_button.png

  3. From the Configuration step, click Next Step.

    LCR-Export_Analytical_Results_to_BigQuery-Next_Step_button.png

  4. From the Parameters step, adjust any data control parameters as needed and then slide the Enable Export toggle to the right.

    CR-Export_to_GCS-edit_clean_room_screen.png

  5. Click Next Step.

  6. Verify that your data control parameters are correct and then click Save.

    CR-Export_to_GCS-edit_clean_room_screen_2.png

Add the Credentials

After enabling the clean room for exports, the clean room owner must first add either their own credentials or those of their partner:

  1. From the LiveRamp Clean Room navigation pane, select Data Management → Credentials.

  2. Click Add Credential.

    add_credential.png

  3. Enter a descriptive name for the credential.

  4. For the Credentials Type, select "Google Service Account".

    CR-Export_to_GCS-edit_credential.png

  5. For the Project ID, enter the project ID.

  6. Enter your Credential JSON (credential JSON is hidden by default, viewable here for demonstration purposes).

    CR-Export_to_GCS-_credential_JSON.png

  7. Click Save Credential.

  8. Verify that your credentials have been added to LiveRamp Clean Room:

    CR-Export_to_GCS-_verify_credential.png

Add an Export Destination Connection

To add an export destination connection:

  1. From the LiveRamp Clean Room navigation pane, select Destinations & Integrations → Destinations.

  2. Click Create Destination Connection.

    image idm2060

  3. Select BigQuery Export.

    CR-Export_to_BQ-choose_account.png

  4. Enter a name and select the BigQuery Credential created in the "Add the Credentials" section above.

    CR-Export_to_BQ-_choose_credential.png

  5. Click Add new account.

  6. Confirm that the new export has been added to your list of GCS export destination accounts.

    CR-Export_to_GCS-_confirm_export.png

Note

The status of the destination connection will be "Configured" initially, but you can continue to export data. Once the first successful export has been processed the status changes to "Complete".

Configure the Question to Share Results

For exports to BigQuery from a Snowflake clean room, you need to configure the question to share the results from your Snowflake account to LiveRamp:

Note

This step does not have to be performed if you’re exporting a question from a Walled Garden (ADH, AMC, and FAA) clean room.

  1. From the LiveRamp Clean Room navigation pane, select Clean Rooms → Clean Rooms.

  2. From the tile for the desired clean room, click Enter.

  3. From the Clean Room navigation pane, select Questions. 

  4. In the row for the question whose results you want to export, click the More Options menu and then select Share Question Results.

    LCR-Export_AWS-Share_Question_Results_menu_selection.png

  5. From the dialog that appears, make sure that the check box for LiveRamp is checked and then click Share.

    LCR-Export_AWS-Share_button.png

Set Up a Data Export within the Clean Room

To set up a data export within the clean room:

  1. From the LiveRamp Clean Room navigation pane, select Clean Rooms → Clean Rooms.

  2. From the tile for the desired clean room, click Enter.

  3. From the Clean Room navigation pane, select Destinations. The Destinations screen shows all destination connections provisioned to the clean room.

  4. Click Provision Destination.

    cr_activation_provision.png

  5. From the Clean Room navigation pane, select Destinations. The Destinations screen shows all destination connections provisioned to the clean room.

  6. Check the check box for the desired destination connection and then click Provision (AWS S3 example shown).

    CR-Export_to_BQ-_provision_Activation_Channels.png

  7. Verify that your destination connection has been added (S3 IAM example shown).

    CR-Export_to_BQ-_verify_Activation_Channels.png

Create a New Export

After you've provisioned the destination connection to the clean room, create a new export:

  1. From the LiveRamp Clean Room navigation pane, select Clean Rooms → Clean Rooms.

  2. From the tile for the desired clean room, click Enter.

  3. From the Clean Room navigation pane, select Exports.

  4. Click + New to open the wizard to create a new export.

    CR-Export_to_GCS-__Exports_page.png

  5. Select the question that you want to export outputs for and then click Next.

    CR-Export_to_GCS-_choose_clean_room_question.png

  6. Select the specific BigQuery Export destination account you want to send run outputs to.

    CR-Export_to_BQ-_choose_export_channel.png

  7. Enter the dataset name and table name for the table runs should be added to and then click Finish.

    CR-Export_to_BQ-_configure_folder.png

  8. Verify that the job has been created. Exports are added to the page. You may view the details of an export by clicking on the name.

    CR-Export_to_BQ-_verify_job.png
    CR-Export_to_BQ-_verify_job_2.png

Note

  • Exports can be paused, which will stop them from sending data upon the completion of each run.

  • Exports cannot be edited or deleted. Changes should be made by pausing the export and creating a new export.

Export Details

When a question runs, the results will be written to the defined table. Each row will have an associated "Run ID" column. There will be a second metadata table created.

In this section: