DE305: Performance Optimisation & Cost Efficiency

by

SFIA Reference: DESN Level 4/5

Data Engineer (Grade 3)

Competency Description

Improves query, job, and resource performance while managing cost within cloud data platforms.

Learning Outcomes

  • Tune queries and review execution plans.
  • Use caching, indexing, or materialised views.
  • Track and optimise pipeline cost and runtime.

Evidence Requirements

Level 4:

  • Improved performance of a slow report or query.
  • Identified high-cost elements in a data pipeline.

Level 5:

  • Designed cost-aware ingestion patterns.
  • Led a review that achieved significant cost savings.

Suggested Learning Activities

  • Analyse cost metrics from Azure Monitor or Synapse.
  • Host a performance tuning workshop.
  • Create a performance profile dashboard.

Recommended Resources

  • Synapse Query Optimisation Docs
  • Cost Management Portal (Azure)
  • Internal Tuning and Benchmark Templates

Leave a Comment