SQP, requirements catalogue, package details, method of rolling out.
DataMart Lifecycle (Development Plan)
| Output | Purpose | Owner | Location |
| Data Source Inventory | Identify relevant data sources within the organisation, including databases, applications, and external sources. | Data Architect/Engineer (with Data Specialist) | myBMT(Data Objects) |
| Data profiling reports | Profile data sources to understand data quality, structure, and relationships. | Data Architect/Engineer (with Data Specialist) | myBMT(Data Fields) |
| Business requirements document | Gather business requirements and user needs for the DataMart. | Data Specialist (with Data Architect/Engineer) | DataMart Design Specification (Functional Spec) |
| Stakeholder alignment summary[SW1] | Align with stakeholders to ensure project objectives and expectations are clear. | Data Specialist (with Data Architect/Engineer) | DataMart Design Specification (User Stories) |
| Output | Purpose | Owner | Location |
| Data models (conceptual, logical, physical) | Design conceptual, logical, and physical data models for the DataMart. | Data Architect/Engineer (with Data Specialist) | DataMart Design Specification (DrawIO) |
| Schema diagrams | Define the schema for tables and relationships within the DataMart. | Data Architect/Engineer | SnapShot Design |
| Architecture design document | Determine the technology stack, infrastructure requirements, and integration points for the DataMart. | Data Architect/Engineer | Medalion Pipeline Design |
| Security and access control specifications | Design security measures and access controls to protect data within the DataMart. | Data Specialist (with Data Architect/Engineer) | DataMart Design Specification (Method of Deployment) |
| Output | Purpose | Owner | Location |
| Minimum viable version of the DataMart with essential features implemented | Identify and prioritise essential features and functionalities based on user needs and business requirements. | Data Architect/Engineer (with Data Specialist) | Power BI Wireframe/PoC (DE&A Workspace) myView Design (DEV) |
| Prototypes or Report mock-ups demonstrating key features and workflows | Develop prototypes or report mock-ups to visualise and validate the MVP’s key features and user workflows. | Data Architect/Engineer (with Data Specialist) | Power BI Wireframe/PoC (DE&A Workspace) |
| Test reports and validation results | Conduct testing to ensure that the MVP meets user expectations and quality standards. | Data Specialist (with Data Architect/Engineer) | myBMT (Tickets) Bug & Change Request |
| Stakeholder feedback and iteration log | Gather feedback from stakeholders and users to iterate on the MVP and refine its features and functionality. | Data Specialist | myBMT (Tickets) Bug & Change Request |
| Output | Purpose | Owner | Location |
| Deployed DataMart system | Deploy the DataMart into production, ensuring it is accessible, reliable, and secure. | Data Architect/Engineer (with Data Specialist) | System Test DataMart (beta) PowerBI Wireframe/PoC (DE&A Workspace) |
| Test reports and validation results. | Conduct testing to ensure data accuracy, system performance, and user acceptance. | Data Specialist (with Data Architect/Engineer) | Acceptance Test DataMart (beta) PowerBI (UAT Workspace) |
| User training materials and documentation | Provide training for users and administrators and create documentation for system usage and maintenance. | Data Architect/Engineer | KnowHow |
| Deployment and go-live checklist | Deploy the DataMart into production environment, monitor performance, and address any issues during go-live. | Data Architect/Engineer (with Data Specialist) | Up-Rev DataMart PowerBI (PRD/Live Workspace) |
Exit Criteria
As there is no perfect data product, the testing is never 100 percent complete. It is an ongoing process. However, there exists the so-called “exit criteria”, which defines whether there was “sufficient testing” conducted, based on the risk assessment of the project.
There are common points that are present mostly in exit criteria:
- Test case execution has been executed by Data Engineering.
- A system has no high priority defects.
- Performance of the system is stable regardless of the introduction of new features.
- The DataMart Product supports all necessary platforms
- User Acceptance Testing is completed
- Changes have been documented
[SW1]Do we have templates for these?