Commits: 24Files Changed: 33 🔄 Alterations 1. global_organisation_ifs.sql3. global_organisation_202409.sql Update: Retention of previous IFS logic for PRU codes and Programme assignment.Note: 202409 now draws from the MIS80 source and includes PRU codes and Programmes across all regions. 4–5, 6–12, 30–33:Includes: Update: Continued development of CDM views for the new generation.Main change: Standardisation on the field … Read more
Additions Common Data Model New Common Data Model (CDM) views have been introduced, conforming to the latest standard: Employee Domain Customer & Supplier Domains Project Domain These views establish a consistent and scalable approach to data modelling across core business domains, streamlining downstream reporting and integration. CDM Functions Key functions have been revised to support … Read more
Additions 202409 ⚠️ Created:global_company_202409.sql ⚠️ Created:global_organisation_202409.sql⚠️ Created:customer_details_202409.sql Datamart views have been created to ensure a seamless transition for clients migrating from 202404 to 202409, providing a structured and usable view for ongoing data integration. These views have been explicitly versioned with the 202409 signature to: Common Data Standard ⚠️ Created:project_core.sql ⚠️ Created:project_codes.sql ⚠️ Created:employee_item_codes_expense.sql ⚠️ … Read more
Additions Customer Details & Project Details APC Alterations General Ledger Transaction Customer Details (CAD & USD) Business Opportunity Dates (Busopp Dates) Notes The following SQL scripts have been modified and differ from previous versions: There were additional alterations to cdm to support transaction error logging 1. ⚠️ DIFFERENT: create_table_comment.sql2. ⚠️ DIFFERENT: create_table_log.sqlSource ID altered to … Read more
When importing rich text data into a Data Warehouse (DWH), it’s often necessary to remove unwanted HTML tags while preserving essential formatting. This guide outlines a method using Python’s BeautifulSoup library to clean and structure the data efficiently. Why Strip HTML Tags? Rich text from sources like web applications, CMS platforms, and APIs often includes … Read more
Additions Customer Details USD ✅ New Addition customer_details_USD – Part of the CAD/USD series of changes.⚠️ Contains Created (Hash) Customer IDs – This will be corrected in the next release. Considerations & Next Steps 🔹 Customer ID Fix Pending – Plan for a smooth transition when correcting the Customer ID field.🔹 UNION-based “mega” list for … Read more
Alterations 15 Files Modified Key Fixes & Enhancements Notes 1. ⚠️ DIFFERENT: employee_absencelimit.sql2. ⚠️ DIFFERENT: infrastructure_changerequest.sql3. ⚠️ DIFFERENT: infrastructure_oshrecords.sql4. ⚠️ DIFFERENT: marketing_Advertising.sql5. ⚠️ DIFFERENT: marketing_campaignTraffic.sql6. ⚠️ DIFFERENT: marketing_campaignTrafficFormSubmissions.sql7. ⚠️ DIFFERENT: marketing_EmailCampaigns.sql8. ⚠️ DIFFERENT: marketing_Events.sql9. ⚠️ DIFFERENT: marketing_Forms.sql10. ⚠️ DIFFERENT: marketing_HubSpotLandingPages.sql11. ⚠️ DIFFERENT: marketing_Meltwater.sql12. ⚠️ DIFFERENT: marketing_pagePerformance.sql13. ⚠️ DIFFERENT: marketing_pagePerformanceFormSubmissions.sql14. ⚠️ DIFFERENT: marketing_SocialMedia.sql15. ⚠️ DIFFERENT: marketing_ThoughtLeadership.sql … Read more