If your Mage app is deployed on Microsoft Azure with Mage’s Terraform scripts, you can choose to launch separate Azure container instances to execute blocks. How to configure pipeline to use Azure Container Instance executor:
  1. Update Project’s metadata.yaml
azure_container_instance_config:
  cpu: 1
  memory: 2
  1. Update the executor_type of the block to azure_container_instance in pipeline’s metadata.yaml and specify executor_config optionally. The block level executor_config will override the global executor_config.
blocks:
- uuid: example_data_loader
  type: data_loader
  upstream_blocks: []
  downstream_blocks: []
  executor_type: azure_container_instance
  executor_config:
    cpu: 1
    memory: 2
  ...

​
Resource management

Get started for free


A fully managed service, where we maintain the infrastructure, guarantee uptime, automatically scale your workloads to handle any volume of pipeline runs, automatically upgrade new versions of Mage Pro only features, monitor your production pipelines, and provide enterprise level support.