Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.mage.ai/llms.txt

Use this file to discover all available pages before exploring further.

​
Config

connector_type: kinesis
stream_name: stream_name
batch_size: 100

​
Authentication

Here are the options to authenticate with the AWS Kinesis.
  1. Add the following keys and values to your environment variables
  • AWS_ACCESS_KEY_ID
  • AWS_SECRET_ACCESS_KEY
  • AWS_REGION
  1. If you deploy Mage on AWS ECS cluster, you can use ECS execution task role to authenticate. You can grant the ECS task permissions to access other AWS services by attaching IAM policies to this ECS task execution role.
If you get the botocore.exceptions.NoRegionError error, try setting the AWS_DEFAULT_REGION environment variable.