Skip to content

Releases: kimberly-emerson/python-etl-sql-postgres

Release list

Pre-release 0.1.0

Pre-release 0.1.0 Pre-release
Pre-release

Choose a tag to compare

@kimberly-emerson kimberly-emerson released this 05 Nov 19:49

Modular ETL orchestration pipeline from SQL Server to PostgreSQL databases. It automates the full lifecycle of database teardown, schema creation, query mapping generation, data extraction, and data loading into production and test environments.

The ETL workflow is coordinated through a single entry point (main.py) and integrates reusable modules for:

  • Dropping and rebuilding PostgreSQL databases and roles
  • Generating source and destination query mappings from a CSV file
  • Extracting source data using parameterized SQL SELECT queries
  • Loading extracted data into destination tables using INSERT queries
  • Optionally seeding a test database with the same data

Next Steps:

  • add sphinx documentation framework
  • add pytest testing