io_config.yaml
.default
(you can
have multiple profiles, add it under whichever is relevant to you)SQL
.
Data provider
dropdown, select Databricks
.
Profile
dropdown, select default
(or the profile you configured your Databricks credentials under).
io_config.yaml
.Replace
or Append
. See the SQL blocks guide for more details on write policies.Data lakes -> Databricks SQL
template or Generic (no template)
.config_profile
from default
if
you have a different profile):Field name | Description | Example values |
---|---|---|
allow_reserved_words | Whether to allow using reserved words as column names. | True/False (default: False) |
auto_clean_name | Whether to automatically clean the column name (replace the empty space with underscore, avoid using number as the prefix of the column name) | True/False (default: True) |
case_sensitive | Whether to support case sensitive columns | True/False (default: False) |
drop_table_on_replace | Whether to drop the table when “if_exists” param is set to “replace”. | True/False (default: False) |
if_exists | Specify resolution policy if table name already exists | ”fail”/“replace”/“append” (default: “replace”) |