May 2024 – Nov 2025 · 1 yr 6 mos · Bengaluru · Hybrid

• Project Name: PREDICTIVE FRAUD INTELLIGENCE (PFI)
• Technologies : SQL,Python, Pyspark, HDFS , Airflow
• Led feature engineering initiatives to build machine learning models for scoring and predicting fraudulent transactions, serving major clients such as Coelsa, New Pay, BaseLine Model, and Pix.
• Redesigned the feature engineering pipeline, achieving a 90% improvement in feature delivery performance, which significantly accelerated model training, and positively impacted product timelines.
• Developed an automated framework for feature creation, eliminating the need for individual code writing, thus enhancing efficiency and scalability.
• Collaborated with data scientists to understand and implement new feature requirements, ensuring alignment with business objectives.
• Designed and implemented a feature correctness and testing framework, establishing rules for each feature family to maintain data accuracy and integrity.
• Improved developer experience, code quality, and modular design through the redesign of key modules, promoting better maintainability, and scalability.
• Attending daily stand-up meetings to update the onsite and offshore teams.
• I received the Visa Innovation Award for building the Feature Explainability tool to showcase the lifecycle of a feature in the A2A feature store.
• Collaborating with cross-functional teams to productionize A2A fraud detection models.

Aug 2023 – May 2024 · 9 mos · Noida, Uttar Pradesh, India · Remote

• Project Name : DWH
• Technologies : SQL,Python, Pyspark, HDFS, MYSQL,EMR,S3,Kafka Consumer
• Responsibilities:
• Create and manage the data integration system by building Pyspark batch and streaming data pipelines to ingest raw OLTP data from multiple RDBMS,SFTP and Streaming sources into S3/HDFS , where tables can be created to support the creation of data cuts and data marts for business analytics.
• Configuring custom scheduler to meet the SLA of all the raw data cuts in automated fashion.
• Debugging and providing BAU support for Pyspark jobs on iteration basis .

Nov 2021 – Aug 2023 · 1 yr 9 mos · Gurugram, Haryana, India · Hybrid

• Product : American Express
• Technologies : SQL Python, Pyspark, HDFS, MYSQL,Git
• American Express Company (Amex) is an American multinational Financial services corporation specialized in payment cards ( CORP , SMEs as well as Consumer) . Reading SORs of different Entities from HDFS and receiving Files through SFTP from the product and business team , post that massaging the data using Pyspark and creating DAAP ( Facts and Dimensions ) to be utilised by business team for the reporting needs.
• Responsibilities:
• Developing Pyspark jobs based on the business rules provided by PO team to provide DAAP.
• Upgrading the Existing BCV system from SAS to new Big Data (HDFS) that is further used to incentivise Amex sales personal .
• Created Key KPIs like Charge Volume for (Consumer and SBS and CORP cards) for AsiaPacific region.
• Designing Data warehouse schema for payments GCS to outsource Data to variousConsumers for their reporting needs.
• Implementing business rules in the data to get Insights.
• Developing SQL queries to perform ETL workSlows.
• Debugging and providing BAU support whenever required in the PI.
• Orchestrating Data pipeline using AMEx in-house tool Event Engine as well as Java Bean workSlows.
• Attending Daily Stand-up meets to update the onsite and offshore team.
• Migrating jobs from magellan to spark for better optimisation .
• Developed utility to understand the Sill rate and data quality of the SORs and Dimensions .

Jan 2021 – Nov 2021 · 10 mos

• Project Name : Data Modernization Duration : 2+ years
• Client : T. Rowe price
• Technologies : AWS, Python, Pyspark, Snowflake, Postgres, DB2
• T. Rowe Price Group, Inc. is an American publicly owned global asset management Firm that offers funds, advisory services, account management, and retirement plans and services for individuals, institutions, and Financial intermediaries.
• Aws S3 is a source where will get data files from grand central which will pull data from adobe and salesforce database and these data files consist of data related to android, iMac and web sources. Reading and massaging of data is done by Pyspark jobs and transfer the data to Snowflake.
• Responsibilities:
• Developing Pyspark jobs for Ingestion Framework.
• Implementing business rules in the data to get Insights.
• Developing SQL queries to perform ETL workflows.
• Used SNS notification mail whenever job got failed.
• Launching the framework on Kubernetes cluster.
• Attending Daily Stand-up meets to update the onsite and offshore team.
• Creating BDDs for code’s functionality testing.

Aug 2019 – Jan 2021 · 1 yr 5 mos

Jan 2019 – May 2019 · 4 mos · Hyderabad Area, India

• Great to learn the core concepts of Data warehousing , ETL , Big data ,AWS along with SQL and python.