Intro to Prefect

This project is meant as an introduction to data engineering through Prefect. This main branch is the starting point. For the completed version, see the complete branch.

Setup

python -m venv .venv
source .venv/bin/activate
pip install -e '.[dev]'
pre-commit install
docker-compose up -d
prefect config set PREFECT_API_URL="http://127.0.0.1:4200/api"
prefect server start

Teardown

docker-compose down