Julian.Kellett SFIA Reference: METL Level 4/5 Data Engineer (Grade 3) Competency Description Implements automated, repeatable DevOps practices and infrastructure as code in data engineering. Learning Outcomes Evidence Requirements Level 4: Level 5: Suggested Learning Activities Recommended Resources
SFIA Reference: INCA Level 4/5 Data Engineer (Grade 3) Competency Description Develops secure, efficient, and responsive integration methods for streaming or API-driven data. Learning Outcomes Evidence Requirements Level 4: Level 5: Suggested Learning Activities Recommended Resources
SFIA Reference: DBDS Level 4/5 Data Engineer (Grade 3) Competency Description Designs optimised, scalable, and governed data models to support analytics and storage efficiency. Learning Outcomes Evidence Requirements Level 4: Level 5: Suggested Learning Activities Recommended Resources
SFIA Reference: DENG Level 4/5 Data Engineer (Grade 3) Competency Description Designs, develops, and maintains data pipelines, ensuring scalability, performance, and quality in support of enterprise reporting and analytics. Learning Outcomes Evidence Requirements Level 4: Level 5: Suggested Learning Activities Recommended Resources
🔗 How to Configure VNet Peering for Azure Data Factory and Oracle Integration This guide walks you through securely connecting Azure Data Factory (ADF) to an Oracle Virtual Machine hosted in a different Virtual Network. By setting up VNet Peering and configuring a Managed Virtual Network Integration Runtime (IR), you can enable private, secure data … Read more
Additions Common Data Model New Common Data Model (CDM) views have been introduced, conforming to the latest standard: Employee Domain Customer & Supplier Domains Project Domain These views establish a consistent and scalable approach to data modelling across core business domains, streamlining downstream reporting and integration. CDM Functions Key functions have been revised to support … Read more
The Data Engineering Team plays a crucial role in ensuring the smooth operation and continuous improvement of our data services. However, many people may not fully understand how we structure our development cycles and why we operate in a particular way. This article aims to provide insight into a typical week in the life of … Read more
Role: Project ManagerContext: Large-scale technical consultancy engagement requiring coordination across engineering, finance, and delivery teams 🔪 Challenge The project manager needed to: Problems included: “I spent hours each week trying to make sense of data from five different places—and still couldn’t guarantee it was accurate.” 🚀 Solution The Data Engineering team: 🌟 Outcome “Now I … Read more
At the heart of every report, dashboard, and project delivery, there’s data—clean, consistent, and flowing on time. That’s what Data Engineering delivers. Whether you’re chasing a deadline, answering a tough question, or leading a major project—we make sure you have the data you need, when you need it. ⚖️ Clarity You get clean, reliable data … Read more
Additions 202409 ⚠️ Created:global_company_202409.sql ⚠️ Created:global_organisation_202409.sql⚠️ Created:customer_details_202409.sql Datamart views have been created to ensure a seamless transition for clients migrating from 202404 to 202409, providing a structured and usable view for ongoing data integration. These views have been explicitly versioned with the 202409 signature to: Common Data Standard ⚠️ Created:project_core.sql ⚠️ Created:project_codes.sql ⚠️ Created:employee_item_codes_expense.sql ⚠️ … Read more