Write unit tests to test pipeline code.
tests
folder in your project folder and put unit tests in this folder.
In your CI/CD pipeline, you can cd
into the project’s folder and run the following command
to run unit tests.
env
variable’s value in the method’s kwargs
is test
.
You can leverage this variable to change the code logic or config used in the unit tests.
BigQuery
IO class in the data loader, and the
Postgres
IO class in the data exporter.