A selection of complex data challenges solved through intelligent architecture, automation, and reverse engineering.
Built a robust process that connects to FTP, downloads file manifests, and compares filenames against audit logs to identify new files. Dynamic scripts fetch, load, and shred XML into relational staging marts for immediate reporting via PowerShell HTML graphs.
Automated the daily file exchange checks ("Reconciliation") with major partners (ABSA, FNB, etc.). Engineered a multi-step SQL Agent Job to Audit, Forecast, and Distribute a color-coded HTML Status Dashboard using PowerShell and SQL Mail.
Designed and developed Staged Data Marts and deployed Dimensional Data Models into production. Enforced strict data quality via Referential Integrity constraints between Fact and Dimension tables for consistent reporting.
Engineered an end-to-end pipeline for Winning/Validation tickets. Authored the strategic business case justifying the move to a formal Data Warehouse architecture for high-performance reporting.
Led the initiative to modernize the development environment by investigating and implementing Git version control. Setup metadata layers for DEV/UAT/PROD on GitHub and documented the compliance process for the group.
Built a comprehensive system to track and analyze Power BI report usage across the organization. Used PowerShell APIs to extract dataset activity and modeled it into a Power BI dashboard to inform business strategy.
Managed critical product data feeds for Apparel, Home, and Sport divisions. Worked with RabbitMQ for message queuing and processed complex XML output files to ensure accurate stock and price data across platforms.
Executed a data migration from SQL Server 2000/2008 to Azure. Created reconciliation tables to balance source vs. destination data and replicated stored procedures to ensure business continuity in the cloud.
Designed and deployed SSAS multidimensional cubes and Power BI reports for high-profile brands like Huawei and Defy. Created "Master Reports" to simplify navigation across complex underlying data structures.