Sep 2021 – Jun 2023 · 1 yr 9 mos · Sunnyvale, California, United States

• Led the development of a scalable, cloud-agnostic Unified Data Platform (UDP) for real-time and batch processing across hybrid environments.
• Built Apache Beam– and Spark–based pipelines with secure, high-throughput processing.
• Integrated multi-cloud and on-prem systems using prebuilt connectors.
• Delivered SDK and workbench for rapid pipeline design and deployment.
• Embedded data governance with lineage, schema registry, and audit logging.
• Automated CI/CD workflows for faster, reliable production rollouts.
• Enabled real-time monitoring, alerting, and resilient job recovery.
• Apache Beam, Spark, GCP Dataproc, Azure Databricks, Cloudbreak (HDP), Kubernetes, Airflow, CI/CD

Oct 2019 – Sep 2021 · 1 yr 11 mos · Sunnyvale, California, United States

• Led the architecture and engineering of Walmart’s Global Data Analytics Platform, delivering scalable solutions across Finance, Supply Chain, Stores, and E-commerce.
• Integrated GCP, Cloudbreak (HDP), and Azure Databricks to enhance platform scalability.
• Enabled real-time and batch processing using Apache Beam, Kafka, and Cassandra.
• Streamlined workflows with Airflow and Automic for unified orchestration.
• Automated CI/CD pipelines using Kubernetes, Concord, and Looper.
• Reduced infrastructure cost through tool consolidation and automation.
• Optimized data delivery across domains ensuring high platform availability.
• GCP, Cloudbreak (HDP), Azure Databricks, Apache Beam, Kafka, Cassandra, Airflow, Kubernetes

Mar 2019 – Oct 2019 · 7 mos · Washington, United States

• Managed HPE’s Enterprise Analytics Platform (EAP) for Installed Base data, enabling advanced reporting and seamless data integration from Salesforce to Hive.
• Directed end-to-end data integration from Salesforce to Hive via IBSV.
• Transformed Hive data using Spark and Scala to create analytical DataFrames.
• Enabled dynamic reporting by migrating data to MongoDB and Qliksense.
• Developed Kafka pipelines for real-time clickstream ingestion into Hive and MongoDB.
• Scheduled batch processing using Oozie for timely data updates.
• Maintained high data accuracy across Hive tables supporting sales analytics.
• Spark, Scala, Hive, MongoDB, Qliksense, Kafka, Oozie, GitHub, Azure, Hortonworks

Jun 2017 – Feb 2019 · 1 yr 8 mos · Columbus, Georgia Area

• Led real-time data ingestion from mainframe systems into enterprise Data Lake clusters, architecting scalable big data zones and secure analytics workflows.
• Designed multi-zone Data Lake architecture using Solr, HBase, and HDFS.
• Directed CDC-based ingestion from IMS, DB2, and VSAM to Kafka streams.
• Built enrichment engines to transform JSON messages to Avro schema.
• Developed tokenization workflows for secure and compliant data processing.
• Enabled near real-time updates to OLTP systems via HBase and Elastic Search.
• Automated batch jobs to convert raw zone data into Parquet for analytics use.
• Kafka, HBase, Solr, HDFS, Avro, JSON, AWS, Oracle GoldenGate, Flink, Docker, Java, MAPR, Atlas, Bitbucket, SqData, Druid

Oct 2016 – Jun 2017 · 8 mos · Albany, New York Area

• Managed AWS-based big data infrastructure and analytics operations, leveraging EMR, Redshift, and Spark for scalable data processing and automation.
• Oversaw AWS services including EMR, S3, and Redshift to support data scalability.
• Processed high-volume datasets using Apache Spark for efficient computation.
• Utilized Tableau, R, SAS, and Python for advanced analytics and visualization.
• Automated deployments with Chef, Puppet, GitHub, and CloudFormation.
• Orchestrated workflows using Oozie and streamlined issue tracking via JIRA.
• Enhanced operational efficiency through robust cloud infrastructure oversight.
• AWS EMR, Redshift, S3, Apache Spark, Tableau, R, SAS, Python, Chef, Puppet, GitHub, CloudFormation, Oozie, JIRA

Aug 2016 – Oct 2016 · 2 mos · Greater Memphis Area

• Led big data initiatives using HDP 2.0 ecosystem, delivering scalable analytics solutions with Spark, Kafka, Hive, and HBase to support logistics operations.
• Developed distributed data workflows using Spark, Hive, and Pig.
• Engineered real-time data streaming pipelines with Kafka.
• Leveraged HBase and Phoenix for efficient data access and storage.
• Utilized Scala and Python to build scalable data processing scripts.
• Applied R and SAS EM 13 for predictive analytics and modeling.
• Ensured compatibility and performance across HDP 2.0 platforms.
• HDP 2.0, Spark, Kafka, Hive, Pig, Scala, HBase, Phoenix, R, Python, SAS EM 13, SAS EG

Jun 2008 – Jul 2016 · 8 yrs 1 mo · Buffalo/Niagara, New York Area

• Delivered enterprise-grade big data solutions using Spark, HQL, Scala, and Python across Hortonworks and Cloudera distributions, supporting critical analytics functions on AWS and Azure.
• Designed and implemented data pipelines using Spark, HQL, and Pig.
• Developed scalable applications in Scala, Java, and Python for analytics use cases.
• Utilized HBase for high-volume data storage and fast retrieval.
• Built predictive models using R and SAS Enterprise Miner.
• Deployed analytics solutions on AWS and Microsoft Azure cloud platforms.
• Delivered distributed data processing solutions using Hortonworks and Cloudera.
• Apache Spark, HQL, Pig, HBase, Scala, Java, Python, R, SAS, Hortonworks, Cloudera, AWS, Microsoft Azure

Dec 2007 – May 2008 · 5 mos · City of Johannesburg, Gauteng, South Africa

• Led system analysis, design, and development of mainframe-based banking applications using COBOL, JCL, DB2, and VSAM to support critical financial operations.
• Enhanced core banking systems using COBOL, JCL, and DB2.
• Improved system performance through optimized DB2 query tuning.
• Collaborated with business teams to convert requirements into technical specs.
• Resolved high-impact production issues to maintain application reliability.
• Delivered system enhancements for improved functionality and uptime.
• Conducted system analysis to support application scalability and compliance.
• COBOL, JCL, DB2, VSAM, CICS, Mainframe Systems, System Analysis, Application Enhancement

May 2007 – Oct 2007 · 5 mos · Halifax, England, United Kingdom

• Contributed to the development, maintenance, and enhancement of mainframe applications using COBOL, JCL, DB2, and VSAM for enterprise clients.
• Developed COBOL-based programs to support key client systems.
• Performed code maintenance to ensure application stability and performance.
• Resolved functional and performance issues, improving application reliability.
• Executed system testing and participated in successful feature rollouts.
• Implemented system enhancements in collaboration with team members.
• Ensured adherence to mainframe development standards across all tasks.
• COBOL, JCL, DB2, VSAM, CICS, Mainframe, System Testing, Application Maintenance

Jul 2004 – May 2007 · 2 yrs 10 mos · Colchester, England, United Kingdom

• Supported development and maintenance of mainframe applications using COBOL, JCL, DB2, and CICS, ensuring seamless data processing and system reliability.
• Developed COBOL programs leveraging DB2 and VSAM for critical business workflows.
• Improved batch processing efficiency by 15% through application optimization.
• Resolved high-priority production issues, minimizing system downtime.
• Enhanced CICS-based applications for better transaction handling.
• Supported and maintained MQ Series for reliable message queuing.
• Collaborated across teams to deliver stable mainframe solutions.
• COBOL, JCL, DB2, VSAM, CICS, IDMS, MQ Series, Mainframe Development