Import Layer of Data Warehouse

Overview: The Import Layer serves as the initial landing zone for all incoming data into the data warehouse. This layer is designed to handle and store data in a variety of formats and from different sources, ensuring a flexible and robust intake process. It acts as a staging area where data can be validated, archived, … Read more

Supplier.Details

Purpose The Common View for Supplier Details, excluding dates or measures, acts as a unified and reliable source for data on business suppliers. It is accessible to different departments and systems across the organisation. This view supports integration with fact tables for reporting and analysis and provides a limited set of dimension attributes. Use Case … Read more

Release 28

Alterations Busopp.Details_Plus (&202407) Remove CONVERT(NVARCHAR(32),HashBytes(‘MD5’, CONCAT_WS(‘|’,src.COMPANY,src.OPPORTUNITY_NO)),2) as busopp_item_id, as this is now generated in get.myView Created dvw.customer_item_202406 as part of removing Company reference from customer (& Supplier) Customer.Details Removed reference to COMPANY (and the associated check of customer.invoice) Customer (and Supplier) COMPANY defaults to 9900 Check for Alterations to Customer.InvoiceCutomer.OrderlineProject.CustomerInvoiceProject.CustomerOrderlineProject.ActivityDetails get.myView COMPANY now included as … Read more

Release 27

Released immediately due to data error discovered in [QFACT_BMT_ACTUAL_HOURS_BY_IAS$] PRD 20240731 Alterations Employee.Hours Change UPLIFT to CAST(GROSS AS DECIMAL(10, 3)) – CAST(NETT AS DECIMAL(10, 3)) AS UPLIFT, As UPLIFT was being delivered with discrepancies between rounding of GROSS and NETT i.e. 21.8104 – 21.81 = -4.0E-4 This was causing an error in both CAST and … Read more

SharePointList To Staging Pipeline

Purpose: Transfer SharePoint List data through azure blob storage and into the DataWarehouse Requires: Prerequisites: Process Steps: 4. Data Pipeline 5. Create pipeline parameters. Create two pipeline parameters. 5. Activities Tab 6. Look up Activity Click on the Lookup activity and go to settings, from there if not already set up create a new connection … Read more

DataSource.SharepointList

Purpose: Transfer SharePoint list the Database environment for DataWarehouse Requires: Process Steps: 4. DataFlow Gen2 5. Power Query Window 6. Get Data 7. More… 8. SharepPoint Online List (NOT Sharepoint List) 9. Enter URL 10. Set Implementation to [2.0] 11. [Next] 12. Choose your list 13. [Create] 14 . Rename Dataflow 15. Select [Cog] on … Read more

Last Published Date

1. Create a blank query in Power Query Editor like so: 2. Keep “Include in report refresh” unselected. 3. Create a Card visual to show “LastPublishedDate”. 4. Before publishing the report, you need to refresh the data of the “LastPublishedDate” table, not refresh the report. 

Project.ActivityDetails

Purpose [FACT_PROJ_ACTIVITY_INFO_OL] unique based on ACTIVITY_SEQ, CONTROL_CATEGORY_KEY This table plans to be unique for ACTIVITY_SEQ only Use Case Owner: Martyn ColeTypical Use Case: Provide details for ACTIVITY_SEQ and Sub Project IDStyle: Dimension, Dimension i.e. Single row per ACTIVITY_SEQ Source Key Parameters CompanyProjectCustomerActivitySeq Sample Exec Response SEQ Dates Measures Codes SQL