Sep 2024 – Jul 2025 · 10 mos · London Area, United Kingdom · Hybrid

• Redkite was acquired by Accenture.**
• Led a team of data professionals to optimize cloud-based data storage and retrieval, engineer scalable data quality pipelines, and streamline development workflows on the Microsoft Fabric platform, resulting in enhanced data-driven decision making.
• Collaborated with a multidisciplinary team to remove bottlenecks and achieve alignment, implementing a scalable and automated data quality pipeline using Soda and PySpark that performed over 6,000 checks, ensuring a flawless data transition.
• Developed and deployed a comprehensive cloud transition and data warehousing solution using Microsoft Azure, Delta Lake Medallion Architecture, and Terraform, which integrated role-based access control and security audits to streamline user access and improved decision-making by managing and analyzing terabytes of data across multiple units.
• Optimized Power BI dashboards, reducing query times by 50%, and successfully migrated CI/CD pipelines to GitHub, enhancing deployment efficiency and reliability.
• Presented complex data workflows to stakeholders using storytelling techniques to ensure clarity and alignment across the organization.

Jun 2023 – Sep 2024 · 1 yr 3 mos · Greater London, England, United Kingdom

• Engineered improvements in data infrastructure by architecting and integrating data lakehouse frameworks using Databricks, PySpark, and Delta Lakehouse Medallion Architecture, which enhanced data ingestion speed by 30% and supported decision-making by improving data accessibility and reliability.
• Built and integrated a custom Data Modeller for SCD2 transformations within a Lakehouse Architecture, ensuring storage efficiency and seamless scalability, which reduced data processing latency by 35% and expanded analytical capabilities.
• Improved query efficiency by 25% and reduced costs through Z-Order Clustering and Adaptive Query Execution, while also strengthening data security measures using Transparent Data Encryption and Dynamic Data Masking.

May 2021 – Jun 2023 · 2 yrs 1 mo · Greater London, England, United Kingdom

Mar 2020 – May 2021 · 1 yr 2 mos

• Managed the construction and maintenance of a high-capacity analytics platform using Apache Spark and Delta Lake, handling vast data volumes and improving throughput significantly.
• Optimized software architecture and developed a real-time streaming solution for motorcycle analytics using Spark Streaming and Azure EventHubs, achieving scalability of up to 20,000 data points per second.
• Engaged in continuous learning and development, completing advanced courses in Big Data Analytics and Cloud Computing, and conducting technical workshops on data optimization and real-time data synchronization.

Jan 2019 – Mar 2020 · 1 yr 2 mos

Oct 2018 – Dec 2018 · 2 mos

Jun 2018 – Sep 2018 · 3 mos · London, United Kingdom

• Built a Web App using Machine Learning that can predict the Level of air pollution from Noise pollution data. This was done for cities outside London where air pollution data is scarce. It can be viewed on my website akeelahamed17.github.io