Our fully managed solution for teams is now available!
Mage Pro will automatically scale your workloads to handle any volume of pipeline runs, while optimizing resource utilization and minimizing costs.
Mage Pro will automatically scale your workloads to handle any volume of pipeline runs, while optimizing resource utilization and minimizing costs.
- Front-end application
- Pipeline executor
- Block executor
Front-end application
Customize the compute resource of the Mage web service. The Mage web service is responsible for running Mage web backend, scheduler service and local block executions. You can customize the CPU and memory of the Mage web service by updating the Terraform variables and then runningterraform apply.
Amazon Web Services (AWS)
Update theecs_task_cpu and ecs_task_memory variables in the
mage-ai-terraform-templates/aws/variables.tf
file.
Google Cloud Platform (GCP)
Update thecontainer_cpu and container_memory variables in the
mage-ai-terraform-templates/gcp/variables.tf
file.
Pipeline executor
Set the pipeline’s executor type to customize the compute resources for pipeline runs. Here are the available executor types:local_pythonk8secs
Default for all blocks in a pipeline
You can set the executor type for all the blocks in a pipeline by specifying theexecutor_type at pipeline level.
Block executor
Mage provides multiple executors to execute blocks. Here are the available executor types:local_pythonk8secsazure_container_instancegcp_cloud_run
Default for all blocks
Mage useslocal_python executor type by default. If you want to specify another executor_type as the default executor type for blocks,
you can set the environment variable DEFAULT_EXECUTOR_TYPE to one executor type mentioned above.