Feb 2025 – Present · 1 yr 4 mos

Feb 2022 – Feb 2025 · 3 yrs

• Implemented data redaction automation process, handling ServiceNow tickets and reducing manual workload by 25 hours weekly.
• Developed an automated workflow that integrated ServiceNow with Snowflake for role requests, reducing manual work by 8 hours daily and improving governance over role access.
• Designed and developed ETL architecture and Data Pipelines from scratch, enabling efficient loading operational data into the Data Warehouse. Achieved an accuracy rate of 99.9% for loaded data.
• Mentored interns on there internship projects
• Developed and implemented a comprehensive data Monitoring framework in Python/Scala and SQL, resulting in a 60% reduction in manual effort required for Finding error.
• Developed an alert system for the Warehouse, reducing employee extra credit usage in Snowflake
• Built a Streamlit-based application to automate data sync between Google Sheets and Snowflake, implementing ETL and RETL for real-time data movement
• Streamlined Airflow data pipelines for enhanced ETL efficiency, cutting data latency by 20%
• Developed a data pipeline using Fivetran to ingest and transform Google Drive Data
• Developed and deployed a custom data ingestion ETL pipeline using AWS Lambda and Snowflake external functions, pulling data from multiple third-party sources for real-time analytics.
• Pulled data from multiple sources like Rest Api, AWS ,Linkedin ,Instagram ,youtube, Datadog ,Salesforce and Workday

Jul 2021 – Feb 2022 · 7 mos

• Project : Airflow Dag Health Report
• Tech Used : Pandas, Snowflake, Airflow
• Project : Airflow DAGs Failure Alerting
• Tech Used - Airflow, Pagerduty API
• Project : Salesforce Opportunity Prediction
• Tech Used - SQL, ML, Snowflake, Thoughtspot
• Project : Orchestration Logging Framework
• Keeping track of all data pipelines triggered via Airflow,Snowflake Task, Fivetran for tracking consistency in data curation.
• Tech Used - Python,Stored Procedure, Airflow Operators, Kubernetes
• Data Ingestion for various 3rd part applications
• Tech Used -Python ,AWS,Snowflake,Airflow

Jan 2021 – Jun 2021 · 5 mos

• Build the CICD pipeline to Deploy sql in Snowflake
• Tech Stack - Github,Jenkins, Docker,Sqitch
• Ingesting the production Data from Autonomiq (QA tool)
• Tech Stack - Snowflake, AWS, Python, Airflow
• Building real time dashboard for QA tool Data Aanalysis
• Tech Stack -Thoughtspot , Snowflake