An Overview of the Medallion Pipeline
Data pipeline name: Medallion to Bronze ETL Pipeline Owner: Data Engineering Team Used since: July 2023 Purpose: The Medallion pipeline is an automated process that handles the extraction, loading, and processing of CSV data from SATUK or GMISUK systems into bronze storage as parquet files. Overview The Medallion pipeline begins by setting source variables based … Read more