Release 66

by

This week, we have completed a significant set of updates, with 56 unique datamart view changes aimed at improving quality, modularity, and stabilisation across domains.

Below is a summary of the key changes:

🐛 Bug Resolutions and Data Quality Enhancements

Customer_ID Bug USD:

  • Resolved in project_details_USD and project_details_plus_USD, aligning sourcing from Client_List.

Missing Fields Corrected in legacy views:

Continuing our efforts to rationalise the impact of deprecating the 202404 series, the following fields have now been added:

  • PROJECT_ID added to busopp_value_202404
  • OPPORTUNITY_NO added to customer_orderline_202404 and customer_orderline_202405
  • PRU_CODE added to project_details_plus_202406 and project_details_plus_202407
  • PERSON_ID added to employee_headcount_202404

These changes ensure continuity and completeness as we transition towards the new structured views.

Employee Hours 202409:

  • employee_hours_202409 migrated into employee_hours_202410.sql as it was not compatible the the current 202409 architecture. To ensure compatibility, 202409 has been built directly into the SVW view set.

APC Region PRU Changes:

Updated PRU mappings in project_details_APC and project_details_plus_APC:

  • 'Maritime Engineering (Infrastructure) - SI' updated from '3007' to '3037'.

CAD Region PRU Changes:

  • project_cost_CAD, project_details_CAD, project_details_plus_CAD, project_revenue_CAD updated:
    • Corrected mappings for ‘CIV’, ‘GOV’, and newly added ‘IND’ Ship Support and Delivery.

🔧CDM

General Statement Quality Improvements

  • Continued efforts to modularise SQL and prepare for attribute lineage-driven views have resulted in widespread improvements.
    • project_meta_template – foundational step towards further modularisation.

Busopp, Customer, Employee, and Project Domains

  • Significant enhancements to:
    • busopp_codes, busopp_dates, busopp_values
    • customer_core
    • employee_codes, employee_dates
    • project_codes, project_dates
    • project_values_* (contingency, cost, expenses, forecast, hours, revenue, time)
  • Core files updated:
    • busopp_core
    • employee_core
    • employee_item_codes_absence, employee_item_codes_expense
    • employee_item_dates_absence, employee_item_values_absence, employee_item_values_expense
    • project_core

History Management Adaptations

  • busopp_codes_202404, busopp_dates_202404
  • employee_codes_202404, employee_dates_202404
    Now adapted to support cdm history tracking and get.myarchive functionality.

Development of First True item_meta Views

  • New item_meta views for suppliers:
    • supplier_item_codes_invoice, supplier_item_codes_purchaseorder
    • supplier_item_dates_invoice, supplier_item_dates_purchaseorder
    • supplier_item_values_invoice, supplier_item_values_purchaseorder

Supplier Domain Extensions

  • Major updates to:
    • supplier_core, supplier_details, supplier_invoice
  • Creation of 202409-stabilised versions:
    • supplier_details_202409
    • supplier_invoice_202409
    • supplier_purchaseorderline_202409

🚀 Summary

This release continues our strategy to build a more modular, reliable, and lineage-friendly datamart layer. Thank you to everyone who supported testing and feedback!

All Check Data Marts ✅

Notes

🔍 Found 56 unique file changes for datamart view in the given period:
1. ⚠️ DIFFERENT: busopp_codes.sql
2. ⚠️ DIFFERENT: busopp_dates.sql
3. ⚠️ DIFFERENT: busopp_values.sql
4. ⚠️ DIFFERENT: customer_core.sql
5. ⚠️ DIFFERENT: employee_codes.sql
6. ⚠️ DIFFERENT: employee_dates.sql
7. ⚠️ DIFFERENT: project_codes.sql
8. ⚠️ DIFFERENT: project_dates.sql
9. ⚠️ DIFFERENT: project_meta_template.sql
10. ⚠️ DIFFERENT: project_values_contingency.sql
11. ⚠️ DIFFERENT: project_values_cost.sql
12. ⚠️ DIFFERENT: project_values_expenses.sql
13. ⚠️ DIFFERENT: project_values_forecast.sql
14. ⚠️ DIFFERENT: project_values_hours.sql
15. ⚠️ DIFFERENT: project_values_revenue.sql
16. ⚠️ DIFFERENT: project_values_time.sql
17. ⚠️ DIFFERENT: supplier_item_codes_invoice.sql
18. ⚠️ DIFFERENT: supplier_item_codes_purchaseorder.sql
19. ⚠️ DIFFERENT: supplier_item_dates_invoice.sql
20. ⚠️ DIFFERENT: supplier_item_dates_purchaseorder.sql
21. ⚠️ DIFFERENT: supplier_item_values_invoice.sql
22. ⚠️ DIFFERENT: supplier_item_values_purchaseorder.sql
23. ⚠️ DIFFERENT: project_details_USD.sql
24. ⚠️ DIFFERENT: project_details_plus_USD.sql
25. ⚠️ DIFFERENT: employee_hours_202409.sql
26. ⚠️ DIFFERENT: employee_hours_202410.sql
27. ⚠️ DIFFERENT: busopp_value_202404.sql
28. ⚠️ DIFFERENT: customer_orderline_202404.sql
29. ⚠️ DIFFERENT: customer_orderline_202405.sql
30. ⚠️ DIFFERENT: project_details_plus_202407.sql
31. ⚠️ DIFFERENT: busopp_core.sql
32. ⚠️ DIFFERENT: busopp_codes_202404.sql
33. ⚠️ DIFFERENT: busopp_dates_202404.sql
34. ⚠️ DIFFERENT: employee_codes_202404.sql
35. ⚠️ DIFFERENT: employee_core.sql
36. ⚠️ DIFFERENT: employee_dates_202404.sql
37. ⚠️ DIFFERENT: employee_item_codes_absence.sql
38. ⚠️ DIFFERENT: employee_item_codes_expense.sql
39. ⚠️ DIFFERENT: employee_item_dates_absence.sql
40. ⚠️ DIFFERENT: employee_item_values_absence.sql
41. ⚠️ DIFFERENT: employee_item_values_expense.sql
42. ⚠️ DIFFERENT: project_core.sql
43. ⚠️ DIFFERENT: supplier_core.sql
44. ⚠️ DIFFERENT: supplier_details.sql
45. ⚠️ DIFFERENT: supplier_invoice.sql
46. ⚠️ DIFFERENT: project_details_plus_202406.sql
47. ⚠️ DIFFERENT: employee_headcount_202404.sql
48. ⚠️ DIFFERENT: project_details_APC.sql
49. ⚠️ DIFFERENT: project_details_plus_APC.sql
50. ⚠️ DIFFERENT: supplier_details_202409.sql
51. ⚠️ DIFFERENT: supplier_invoice_202409.sql
52. ⚠️ DIFFERENT: supplier_purchaseorderline_202409.sql
53. ⚠️ DIFFERENT: project_cost_CAD.sql
54. ⚠️ DIFFERENT: project_details_CAD.sql
55. ⚠️ DIFFERENT: project_details_plus_CAD.sql
56. ⚠️ DIFFERENT: project_revenue_CAD.sql

Leave a Comment