Delta Lake (S3)

Configuration Parameters

To use Delta Lake on AWS S3 as a destination in Mage, provide the following parameters:

Key	Description	Example Value	Required
`aws_access_key_id`	Your AWS access key ID. Required to authenticate with S3.	`AKIAIOSFODNN7EXAMPLE`	✅
`aws_secret_access_key`	Your AWS secret access key. Used for writing to the S3 bucket.	`wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY`	✅
`aws_region`	AWS region where your S3 bucket is located.	`us-west-2` (default)	✅
`bucket`	Name of the S3 bucket where the Delta table is stored.	`mage-spark-data`	✅
`table`	Logical name of the Delta table that Mage will write to.	`dim_profiles_v1`	✅
`mode`	Write mode: - `append`: Adds rows to the table. Fails if schema changes. - `overwrite`: Replaces all existing rows and recreates the table.	`append` (default) or `overwrite`	✅
`object_key_path`	Path inside the S3 bucket where the Delta table is written. Exclude `s3://`, bucket name, and table name from this path.	`users/ds/20250708`	✅

The object key path is relative to the S3 bucket and should not include the scheme (s3://), bucket name, or table name.
Mage uses the delta-rs engine for writing data to Delta Lake on S3.
Use overwrite mode with caution: it deletes all existing rows and recreates the table.