Release 72

This release documents updates to the Data Warehouse covering changes made since 30 June. It focuses on the continued rollout of CDM-aligned views and early implementation of Resource views. πŸ” Customer & Supplier Domains customer_core_details supplier_core_details πŸ‘₯ Employee Domain employee_hours Absence-Related Views employee_item_codes_absenceemployee_item_dates_absenceemployee_item_values_absence employee_meta_codes πŸ“ Project Domain project_item_codes_forecastproject_item_values_forecast πŸ”§ Resource Domain (Initial Release) resource_item_codes_activityresource_item_values_activity

Release 71

Changes busopp_dates_202409 Updated to source Wanted Delivery Date from the refactored QFACT_BUSINESS_OPP_OL (formerly FACT_BUSINESS_OPP_OL$). project_value_202410 Now filtered to exclude rows where CONTROL_CATEGORY is NULL. OCNS / CEFAS DataViews These views provide an overview of the product-related DataViews derived from OCNS (Offshore Chemical Notification Scheme) and CEFAS (Centre for Environment, Fisheries and Aquaculture Science) regulatory sources. … Read more

Release 70

View: project_forecast_202409 Enhancements: Spark-SQL Compatibility and Safe-Code Updates Changes Implemented To improve compatibility with Spark SQL and prepare views for future transition into Fabric or Lakehouse environments, the following adjustments have been made: Outstanding Compatibility Issues 1. IIF() in object CODE should be CASE 2. Square brackets on reserved words (e.g. [identifier]) 3. CF$ field … Read more

Release 68

πŸ”§ Summary of Changes This week’s release includes updates to four DataMart view SQL files, all related to a recent data unification issue affecting the CAD domain. The issue arose due to conflicting records across two client lists. This has now been resolved by aligning with the authoritative CL extracted from the Vision database (last … Read more

Release 67

πŸ—‚οΈ Summary by Change Type Many of the changes in this release were introduced to support the dynamic generation of Common Table Expressions (CTEs) as part of the myBMT auto-creation logic. As such, the majority were structural or naming updates to improve integration and metadata alignment. There were limited functional changes, namely: Change Type Example … Read more

Release 66

This week, we have completed a significant set of updates, with 56 unique datamart view changes aimed at improving quality, modularity, and stabilisation across domains. Below is a summary of the key changes: πŸ› Bug Resolutions and Data Quality Enhancements Customer_ID Bug USD: Missing Fields Corrected in legacy views: Continuing our efforts to rationalise the … Read more

Fabric-Aligned Data Layering Model

Our data architecture follows a structured, layered approach based on the Medallion model. It aligns with Microsoft Fabric principles and best practices, supporting efficient data ingestion, transformation, governance, and reporting. Landing Layer This layer receives raw data files (typically CSV format) from external systems into secure landing zones. Bronze Layer Bronze provides the initial structured … Read more

Release 65

Scope: Updates to Common Data Model (CDM) and project-specific viewsTotal File Changes: 34 πŸ”„ Summary of Key Changes βœ… Stabilised Views for 202409 Reporting These views are now stable and finalised for the 202409 reporting cycle, helping to prevent reuse issues in future CDM deployments. πŸ› οΈ Updated PRUs for Project Views CAD Region Updates: USD … Read more

Release 64

Summary of Changes by View 1. project_details_plus_USD & project_details_plus_CAD Status Logic Updated Project Manager Email Added 2. project_details_plus_CAD & project_details_USD Column Name Adjustment 3. project_details_plus_APC, customer_details_APC, project_details_APC PRU Code Mapping Enhancement 4. global_company & global_company_202409 Expanded Source 5. global_organisation & global_organisation_202409 Same as Above 6. employee_item_codes_absence, employee_item_dates_absence, employee_item_values_absence Minor Logic Refinements 7. dates_DIM_DATE_202409 Performance Optimisation … Read more

Release 63

πŸ†• What’s New New Project View (Item 207) Added project_details_plus_APC to complete the set for regional project reporting. Improved Date Views (Items 20–21, 27–30, 204–205) Programme ID Enhancements (Items 206, 208) Integrated clearer programme identification fields from MIS80 into global organisation views, allowing for cross regional identification. πŸ”‚Development/Improvements for cdm Notes The following files were … Read more