Refresh SQL Endpoint Metadata

When working with Microsoft Fabric, one common challenge is keeping the SQL endpoint in sync with the Lakehouse endpoint after a pipeline run. Fabric provides two endpoints for every Lakehouse: Why does the SQL endpoint sometimes lag? The SQL endpoint doesn’t automatically refresh its metadata the moment new data lands in the Lakehouse. Instead, a … Read more

Head of Reporting & Analytics Delivery (Grade 5)

Role Purpose The Head of Reporting & Analytics Delivery provides leadership for the organisation’s reporting, analytical outputs, and stakeholder-facing data products. The role exists to ensure that: The role focuses on: Scope and Impact The role: The Head of Reporting & Analytics Delivery operates with: Key Responsibilities (SFIA-8 Aligned) Strategy and Direction (SFIA: Information Strategy, … Read more

Running a Stored Procedure for Multiple Dates in Power BI

Purpose:To run the stored procedure get.myArchive from Power BI for a series of previous Sundays (for example, the last six Sundays), and optionally combine or parameterise the results. 🧭 Background The get.myArchive procedure is designed to retrieve snapshot data for a specified date.By default, Power BI passes a single date parameter such as: However, when … Read more

Architecture Rules of the Road

A calm, consistent, and clever approach to data engineering. 🔹 1. Look in the Box First Before inventing a workaround, check what already exists.If Microsoft or IFS built it, use it — it’s likely more robust, secure, and supported. 🔹 2. Easy Landings Data should arrive safely and predictably.Keep import containers simple, standardised, and transformation-free.Bronze … Read more

Standards Statement: Non-Proliferation of Information

To ensure efficiency, compliance, and trust in the Data Warehouse, we commit to the principle of non-proliferation of information. This means that data will be held and processed in a way that avoids unnecessary duplication, ensures clear lineage, and retains only what is required for business and regulatory purposes. Standards This approach ensures the Data … Read more

Look in the box first

Should We Reuse Standard Dynamics 365 / Dataverse Tables for Our In‑House Apps? 1) Why We’re Talking About This We’re starting an important conversation: when we build apps internally, should we lean on the standard tables already in Dynamics 365 / Dataverse (like Account, Contact, Opportunity, Project), or should we keep spinning up new SharePoint … Read more

Level 5 Competency Self-Assessment Matrix

Competency Area Element Indicative Score (1–5) Target (6 mo) Evidence / Example Activities Priority Data Management Devise & implement MDM processes (classification, security, quality, ethics, retrieval & retention) 4 5 Introduced soft/hard delete strategy; implemented RPV & last-seen frameworks; designed employee / project / customer domain MDM structures; strong data security awareness (container-level). M Derive … Read more

Roadmap: to Level 5 Readiness

Month Theme / Focus Area Key Actions Tangible Evidence / Deliverables Success Indicators Month 1 Baseline review & planning • Confirm current Level 5 competency scores and priorities• Align with manager/mentor on fellowship expectations• Map your influence across Data Engineering + Analytics disciplines Updated self-assessment & evidence tracker Clear alignment between Data Engineering objectives and … Read more

Personal Playbook: Shiny Keys Mindset 

I thrive where challenge, novelty, and passion meet. I learn visually and by doing things myself. Engagement is key for me – if my brain isn’t bought in, it can’t focus on the task. Guide me with clarity of purpose, insight, novelty and challenge and I’ll deliver energy, creativity, and continuous improvement.  🧩 How I Work Best  … Read more