Julian.Kellett View: project_forecast_202409 Enhancements: Spark-SQL Compatibility and Safe-Code Updates Changes Implemented To improve compatibility with Spark SQL and prepare views for future transition into Fabric or Lakehouse environments, the following adjustments have been made: Outstanding Compatibility Issues 1. IIF() in object CODE should be CASE 2. Square brackets on reserved words (e.g. [identifier]) 3. CF$ field … Read more
This proposal outlines a phased approach to broaden the scope of our Data Engineering capability, incorporating Microsoft Fabric as a unified analytics platform and evolving our approach to include foundational elements of AI Engineering. The goal is to create an agile, scalable, and intelligent data platform that supports operational analytics, predictive insights, and innovation. 1. … Read more
A novel about IT, DevOps and Helping your Business Win
SFIA-8 Aligned Overview As Head of Data Engineering & Analytics (Grade 5), you provide strategic oversight and operational leadership for the design, delivery, and assurance of data pipelines, analytics platforms, and trusted reporting across the business. This role brings together Data Governance, Engineering, Reporting, and Advanced Analytics into a unified, high-confidence service that enables accurate … Read more
🔧 Summary of Changes This week’s release includes updates to four DataMart view SQL files, all related to a recent data unification issue affecting the CAD domain. The issue arose due to conflicting records across two client lists. This has now been resolved by aligning with the authoritative CL extracted from the Vision database (last … Read more
📘 Context The CODESSTRING field returned from Oracle contains serialised key-value pairs using non-printing ASCII characters: Example value: ✅ Goal Convert this encoded string into structured columns in Power BI, e.g.: ACCOUNT CODE_B CODE_C CODE_D CODE_E 10201 200 2011072 🛠️ Solution: Power Query Function Step 1: Create the Parsing Function Step 2: Apply the Function … Read more
Direct Sources Indirect Sources
🗂️ Summary by Change Type Many of the changes in this release were introduced to support the dynamic generation of Common Table Expressions (CTEs) as part of the myBMT auto-creation logic. As such, the majority were structural or naming updates to improve integration and metadata alignment. There were limited functional changes, namely: Change Type Example … Read more
✅ What You’ll Need 🛠️ Step-by-Step Power Query Approach Step 1: Load both tables into Power Query Step 2: Create a Cross Join (Employee × Month) Step 3: Add FTE Logic (Human Version in M) Now, for each row (i.e. employee × month), add a custom column to calculate the monthly FTE: 🧾 Final Step: … Read more