Scope covered by the project and any documents received.
Technical Perspective
The Data Warehouse Development Quality Plan describes the creation, organisation, movement, change and storage of data from the perspective of the technical and physical implementation.
The scope of the Data Warehouse Development Quality Plan encompasses the following key areas:
- Data Planning
- Data Acquisition
- Data Processing & Maintenance
- Data Publishing & Sharing
- Snapshot & Archive
Business Perspective
The business perspective is defined by the data specialist and stewards defining business requirements for data, only then can data engineering be able interpret these to execute the requirements to provide the data. Quality issue occur when the business requirements are not clear or if a business term is bound to multiple data elements.
For example…
If we were to imagine asking for the organisation’s definition of a ‘customer’. It could be an IFS Account ID, it could be a payor in Sage, it could be a customer number in HubSpot.
The point is that the business term may have different (or encompass multiple) data elements depending on the context and the only reasonable way for a technical oriented stakeholder to execute the business requirements is to have the capability to look it up in a catalogue, trace its lineage, extract/process the data, and ultimately provision it back to the ‘Business View’.
Source and Third-Party Perspective
The most common cause of production-specific data quality issues is the ingestion of third-party data sources. This is because there is no control over the underlying data; it can be reliable at one moment but suddenly change without notice. These issues may also be difficult to fix immediately, thereby persisting for some time without resolution.