Create a BigQuery Temp Dataset
The BigQuery connection accepts an optional Temp Dataset ID: a dataset where the BigQuery JDBC driver stores large query results and temporary tables. It is used when BigQuery is a source datastore; enrichment datastores do not use it. Creating the dataset with a short table expiration keeps intermediate data from accumulating and automatically reduces storage costs.
This guide walks you through creating that dataset in the BigQuery console, inside your Google Cloud account.
Warning
When reusing a temp dataset that already exists in BigQuery, the service account must have the bigquery.tables.create permission on it to pass the connection test and proceed to the datastore creation.
Steps
Step 1: Navigate to the BigQuery console within your Google Cloud Platform (GCP) account.
Step 2: Click the vertical ellipsis next to your project; it opens a popup menu. Click Create dataset to set up a new dataset.
Step 3: Fill in the details to create the new dataset.
Info
- Dataset Location: select the location that aligns with where your other datasets reside, to minimize data transfer delays.
- Default Table Expiration: set the expiration to
1 dayto ensure any table created in this dataset is automatically deleted one day after its creation.
Step 4: Click the Create Dataset button to apply the configuration and create the dataset.
Step 5: Navigate to the created dataset and find the Dataset ID in the Dataset Info section. Enter it in the Temp Dataset ID field of the connection form.
Where the field lives
The Temp Dataset ID field is part of the connection's properties; see the Add Source Datastore field reference.