Sources
Dremio
Configuration
This source uses the Dremio Arrow Flight Client to connect and execute SQL queries and shares most of its settings.
For more details, refer to the Dremio Python Client documentation.
Note: Mage’s implementation of the Dremio source does not allow the
queryconnection parameter.
Required Parameters
| Key | Description | Sample Value |
|---|---|---|
username | Username of the Dremio account used for authentication. | ABC123 |
schema | Dremio source table schema. | ABC123 |
source_backend | SQL source backend used to query data from Dremio (see section below). | postgresql |
password | Password for the Dremio account. (Required if no token is provided.) | ABC123 |
token | Personal Access Token or OAuth2 Token. (Required if no password is provided.) | ABC123 |
Optional Parameters
| Key | Description | Sample Value |
|---|---|---|
hostname | Hostname or IP address of the coordinator node (defaults to localhost). | localhost |
port | Dremio’s Arrow Flight server port (defaults to 32010). | 32010 |
tls | Enables TLS encryption for the connection. | false |
disable_certificate_verification | Disables TLS server certificate verification. | true |
path_to_certs | Path to trusted certificates for TLS connections. | /path/to/certs |
session_properties | Key-value pairs for session properties. | { "key": "value" } |
Source Backend
To maintain consistent data extraction quality, this source allows specifying a preferred SQL source backend.
Currently supported backend sources:
postgresqlmysqlmssql
Note:
OracleDB and Snowflake do not require asource_backend.
Internal tables created by S3 or other object storage also do not require a backend source.