Data engineering involves ensuring the correct systems are available to enable the collection, analysis and extrapolation of data.
| Skill level | Description |
|---|---|
| Awareness | You can: show an awareness of the need for engineering support to design and deliver products into the organisation appreciate the need to cleanse and prepare data before including it in data science products and can put reusable processes and checks in place show an awareness of different architectures (including cloud and on-premise) and data manipulation and transformation tools |
| Working | You can: identify and engage with the appropriate engineering support to design and deliver products into the organisation understand the reasons for cleansing and preparing data before including it in data science products, recognise the processes and tools involved, and put reusable processes and checks in place access and use different architectures (including cloud and on-premise) and data manipulation and transformation tools deployed within the organisation |
| Practitioner | You can: work with data engineers and data scientists to design and deliver products into the organisation effectively understand the reasons for cleansing and preparing data before including it in data science products and can put reusable processes and checks in place access and use a range of architectures (including cloud and on-premise) and data manipulation and transformation tools deployed within the organisation |
| Expert | You can: help to identify the data engineering requirements for any data science product, while working with data engineers and data scientists to design and deliver those products into the organisation effectively understand the need to cleanse and prepare data before including it in data science products and can put reusable processes and checks in place understand a broad range of architectures (including cloud and on-premise) and data manipulation and transformation tools deployed within the organisation, and can use these tools appropriately and help others use them |