Execute block runs in separate tasks.
ecs
in pipeline’s metadata.yaml file.
There’re 2 ways to customize the ECS executor config,
ecs_config
in project’s metadata.yaml file. Example config:
executor_config
at block level in pipeline’s metadata.yaml file. Example config:executor_type
at pipeline level and set run_pipeline_in_one_process
to true.
executor_config
can also be set at pipeline level. Here is the example pipeline metadata.yaml:
Field name | Description | Example values |
---|---|---|
assign_public_ip | Whether to assign public IP to the ECS task. | true/false (default: true) |
cpu | The CPU allocated to the ECS task. | 1024 |
enable_execute_command | Whether to enable execute command for debugging | true/false (default: false) |
launch_type | The launch type of the ECS task. | FARGATE |
memory | The memory allocated to the ECS task. | 2048 |
tags | The tags of the ECS task. | [‘tag1’, ‘tag2’] |
wait_timeout | The maximum wait time for the ECS task (in seconds). The default wait timeout for the ECS task is 10 minutes. Setting to -1 will disable waiting. | 1200 (default: 600) |