Configuration

This source uses the Dremio Arrow Flight Client to connect and execute SQL queries and shares most of its settings.
For more details, refer to the Dremio Python Client documentation.

Note: Mage’s implementation of the Dremio source does not allow the query connection parameter.


Required Parameters

KeyDescriptionSample Value
usernameUsername of the Dremio account used for authentication.ABC123
schemaDremio source table schema.ABC123
source_backendSQL source backend used to query data from Dremio (see section below).postgresql
passwordPassword for the Dremio account. (Required if no token is provided.)ABC123
tokenPersonal Access Token or OAuth2 Token. (Required if no password is provided.)ABC123

Optional Parameters

KeyDescriptionSample Value
hostnameHostname or IP address of the coordinator node (defaults to localhost).localhost
portDremio’s Arrow Flight server port (defaults to 32010).32010
tlsEnables TLS encryption for the connection.false
disable_certificate_verificationDisables TLS server certificate verification.true
path_to_certsPath to trusted certificates for TLS connections./path/to/certs
session_propertiesKey-value pairs for session properties.{ "key": "value" }

Source Backend

To maintain consistent data extraction quality, this source allows specifying a preferred SQL source backend.
Currently supported backend sources:

  • postgresql
  • mysql
  • mssql

Note:
OracleDB and Snowflake do not require a source_backend.
Internal tables created by S3 or other object storage also do not require a backend source.