Sanket Vishwakarma

Data Engineer

Mumbai, India4 yrs 2 mos experience

Most Likely To SwitchAI Enabled

Key Highlights

Expert in Data Engineering with AI and GenAI technologies.
Proven track record in optimizing data architecture.
Strong collaboration skills driving innovative solutions.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech industries.

Contact

Skills

Core Skills

Data EngineeringSolution ArchitectureAutomationData AnalysisData VisualizationDevopsData QualityData IntegrationCost OptimizationTeaching

Other Skills

AI and GenAIAPI integrationsAWSAWS AppflowAWS CloudFormationAWS Command Line Interface (CLI)AWS GlueAWS Identity and Access Management (AWS IAM)AWS LambdaAWS Step FunctionsAirflowAmazon AthenaAmazon RedshiftAmazon S3Amazon Web Services (AWS)

About

A graduate of Jadavpur University with a Bachelor of Science in Mathematics and Statistics, I currently serve as a Data Engineer at Kellanova. My expertise lies in leveraging AI and GenAI technologies to drive impactful solutions, conducting research and proof-of-concept initiatives, and optimizing data architecture with tools like Snowflake, Airflow, and AWS Appflow. Collaborating with business users and regional teams, I contribute to the seamless integration of innovative tools and the development of robust utility dashboards. At Kellanova, I work alongside cross-functional teams to deliver solutions that improve operational workflows and enhance analytics capabilities. With a focus on sustainable deployments and knowledge sharing, I am motivated to create data-driven strategies that align with organizational goals. My approach is rooted in collaboration, leveraging diverse perspectives to foster innovation and drive success.

Experience

4 yrs 2 mos

Total Experience

2 yrs 1 mo

Average Tenure

2 yrs 9 mos

Current Experience

Kellanova

Data Engineer

Sep 2023 – Present · 2 yrs 9 mos · Mumbai, Maharashtra, India · Hybrid

Data Engineer at Kellogg's (Global Data Analytics Team)
Responsibilities:
Collaborated closely with business users and regional development teams to gather and understand requirements, leveraging AI and GenAI to deliver effective solutions.
Conducted research and proof of concept (POC) initiatives to evaluate and integrate new tools such as Snowflake, Airflow, DBT, Dagster, and AWS Appflow, Elastic Beanstalk for optimizing data architecture and workflows.
Provided support to sustainment and regional teams, ensuring smooth deployments and imparting knowledge through comprehensive KT sessions on developed utilities.
Achievements:
Engineered a utility dashboard using Python, Step Functions, Lambda, and API integrations to enhance transparency in resource consumption by Organization, thereby automating and simplifying insights into Ingestion and Orchestration Jobs.
Presented actionable insights through Power BI reports, enabling business stakeholders to easily monitor job success and failures.
Implemented DevOps CI/CD pipelines to improve deployment reliability and reduce risks, incorporating features like auto-merge, advanced branch strategies, and rule sets.
Built a custom Snowflake Streamlit marketplace for Data Quality and Governance, integrating business rule execution within DBT jobs, real-time dashboards, and an approval workflow for new requests. Used LLM models to generate SQL from natural language inputs, improving data quality by 65%.
Impact:
Streamlined operations and reduced manual effort significantly by 65-75%, improving operational efficiency and freeing resources for more strategic tasks.
Fostered a culture of continuous learning and innovation within the team, driving improvements in data engineering practices and technologies.

AI and GenAISnowflakeAirflowDBTAWS AppflowPython+5

Edelweiss tokio life insurance

Data Engineer

Apr 2022 – Sep 2023 · 1 yr 5 mos · Mumbai Metropolitan Region · Remote

Data Engineer at ETLife
Pipeline and Job Management:
Developed pipelines for agent's commission related data, involving complex queries, multiple sources, delta loads, API integrations, and displaying content for agents.
Modified and debugging of Glue PySpark jobs for business needs.
Improved performance using Spark techniques and delta loads.
Tool Replacement and Integration:
Conducted POC for new resource to replace a decommissioned ingestor tool.
Ensured seamless integration from D365 ERP systems, managing Glue jobs, batch files, stored procedures, and data models with minimal downtime by doing POC on C-Data and deployed it in production seamlessly with minimal changes and impact on downstream orchestration jobs.
Cost Optimization:
Identified and removed non-relevant Glue jobs and Orphan tables on RDS database.
Automated critical Glue jobs, saving $2000/month using sync database for ERP systems.
Data Provision and Vendor Management:
Utilized Pentaho for SQL scripting and data provision.
Managed customer data provisioning using OData API to third party using python and API.
Collaboration and Knowledge Transfer:
Provided KT on reverse feed ecosystem.
Developed delta load logic for the Pragati frontend system for policy logging.
Supported data science team for model building and predictions for customer experience enhancement.

GluePySparkD365 ERPPentahoOData APISQL+2

Cognizant

IT Programmer

Oct 2021 – Mar 2022 · 5 mos · Kolkata, West Bengal, India · Remote

Performed statistical analysis on user's data for Macy's shopping website US.
Automated webpage using X-path and selenium tool for automation testing and debugging issues on web.
Performed EDA on multiple data sources and extracted meaningful insights.

Statistical AnalysisSeleniumEDAData AnalysisAutomation

Merit academy-an iit ju alumni initiative

Subject Matter Expert

Jul 2018 – Mar 2021 · 2 yrs 8 mos · Kolkata metropolitan area, West Bengal, India · Hybrid

Taught More than 50+ students of class 10-12 and college undergraduates (Basic and advanced Mathematics)
Got multiple recommendations from the parents of these children for scoring well in Mathematics than rest subjects.

MathematicsTeaching