Overview The myosh_Archive notebook is designed to maintain a complete and accurate archive of records from the MyOSH API. It ensures that no data is lost by identifying gaps in the current API response and backfilling missing records, then merging everything into a single, consolidated archive stored in the Azure Data Lake container. Why Do … Read more
Overview The cdm__Archive_upsert notebook is designed to help keep accurate historical records of data. It implements a technique called Slowly Changing Dimension Type 2 (SCD2), which means instead of overwriting old information, it creates a timeline of changes so you can see what was true at any point in time. This method ensures that previous … Read more
When working with Microsoft Fabric, one common challenge is keeping the SQL endpoint in sync with the Lakehouse endpoint after a pipeline run. Fabric provides two endpoints for every Lakehouse: Why does the SQL endpoint sometimes lag? The SQL endpoint doesn’t automatically refresh its metadata the moment new data lands in the Lakehouse. Instead, a … Read more
Weekly Release Note – Week Ending 03 November 2025 New Views project_meta_codes_pmn A new DataMart view based on data sourced from the SharePoint List PMN, processed via a GEN2 Dataflow to the Bronze layer.🔗 View Documentation This view enables portfolio and project management insights by transforming Project Manager Narratives (PMNs) into a structured, analysable format. … Read more
Purpose This view supports financial control and transparency by standardising balance-level data for consistent reporting and reconciliation. It helps finance and business leaders understand balance movements, inter-company positions, and the relationship between projects, programmes, and cost centres. Use Case Suggested dashboard insights: Source Integration with Dimension / Reference Tables Joins used (per SQL): (none in … Read more
Purpose This view provides a clear and consistent way to analyse individual General Ledger transactions across the organisation. It breaks each posting down into structured attributes — such as journal, project, programme, or inter-company activity — so that financial movements can be explored, reconciled, and connected to operational detail. Use Case Suggested dashboard insights: Source … Read more
Purpose This view provides a consistent and detailed picture of General Ledger activity across the organisation. By standardising ledger attributes and dimensional codes, it enables reliable analysis of financial movements, balances, and reconciliations — all within a single, governed structure. This view supports finance and audit teams in maintaining clarity and confidence in financial data. … Read more
DataMart views changed since 01-Oct-2025. Executive summary New views Renamed / globalised Downstream dependencies: Corrections Improvements to source identification & aliasing Purpose: Ensure tables are identified using their non-dollar names for lineage and metadata consistency. Change pattern:'{“Source”:”ifs.[QFACT_BMT_DWH_INVOICE_TAB_IAS$]”}’ as SOURCE_SYSTEM→'{“Source”:”ifs.[QFACT_BMT_DWH_INVOICE_TAB_IAS]”}’ as SOURCE_SYSTEM Views updated: Global query structure change (Beta & 202409 queries) Adopted a consistent CTE … Read more
Purpose:To run the stored procedure get.myArchive from Power BI for a series of previous Sundays (for example, the last six Sundays), and optionally combine or parameterise the results. 🧭 Background The get.myArchive procedure is designed to retrieve snapshot data for a specified date.By default, Power BI passes a single date parameter such as: However, when … Read more
Project Managers Narrative Purpose This view supports a range of portfolio and project management insights, helping decision-makers understand delivery health and emerging risks across all active projects. It transforms Project Manager Narratives (PMNs) into a structured, analysable format, making it easier to identify recurring risks, schedule pressures, and delivery challenges. By standardising how commentary is … Read more