Easily plug in your own data integration sources and destinations with Mage Pro.
data_integrations
folder inside your project directory.sources
: for your custom data source integrationsdestinations
: for your custom data destination integrationscustom_source_1
) containing:
__init__.py
file with the integration classREADME.md
for documentationtemplates/
directory with a config.json
file for default configurationmetadata.yaml
file in each of the sources/ and destinations/ folders to register the integrations with Mage Pro.metadata.yaml
file inside the
respective sources/
or destinations/
subfolders under data_integrations
.
📘 Example: sources/metadata.yaml
destinations/metadata.yaml
name
: Display name shown in the Mage UI dropdown.module_name
(optional): The class name defined in the source’s __init__.py
file. Defaults to the name
field with spaces removed.uuid
(optional): Folder name of the source. Defaults to the lowercased name
, with spaces replaced by underscores.mage_integrations
to data_integrations
like so:
source_uuid
and SourceModuleName
with the actual folder name and class name of your custom source.
discover_streams
method:
config
you provide contains all required fields expected by your source class.discover_streams()
returns an empty list or raises an error, check your source implementation or credentials.