Sources
BigQuery
Configuration
To set up the BigQuery source, provide the following configuration parameters:
Key | Description | Sample Value |
---|---|---|
path_to_credentials_json_file | Path to your Google service account credentials JSON file. If Mage is running on GCP, you can leave this null to use the instance’s service account. | /path/to/service_account_credentials.json |
dataset | BigQuery dataset you want to read data from. | example_dataset |
credentials_info | An alternative way to specify Google service account credentials directly as a dictionary. | Structure shown below |
credentials_info
structure:
Optional Configs
Key | Description | Sample value |
---|---|---|
skip_schema_creation | If true , Mage won’t run CREATE SCHEMA command. For more information, see this issue | true |
lower_case | If true , Mage will set all columns name as lower case. Default is true | true |
Required permissions
Your BigQuery account should at least have the below permissiont to use the BigQuery destination
Your account should also have “BigQuery Data Editor” role for the BigQuery dataset you specified in the config.