Ankit Pandey 🇮🇳

Software Engineer

Varanasi, Uttar Pradesh, India6 yrs 8 mos experience

Most Likely To Switch

Key Highlights

Expert in optimizing data architectures for cost efficiency.
Proficient in building real-time analytics systems.
Strong background in machine learning and web development.

Stackforce AI infers this person is a Data Engineer with expertise in SaaS and AI/ML solutions.

Contact

ankitp@dewsolutions.in LinkedIn

Skills

Core Skills

Data EngineeringCloud ComputingMachine LearningBusiness IntelligenceCloud Cost OptimizationWeb DevelopmentProgramming

Other Skills

AWSAWS GlueAWS KinesisAWS LambdaAWS RedshiftAirflowAmazon KinesisAmazon SQSAmazon Simple Notification Service (SNS)Apache KafkaApache SparkCCore JavaData GovernanceData Warehousing

About

Data platform engineer with a total professional IT experience of 5+ yrs in core domain of Data Warehouse & Data Modeling, ETL, Python backend and various AWS, DataBricks and GCP technologies including EMR,AirFlow, Lambda, Kinesis, Athena, Delta tatable, Step Functions, Redshift, Terraform,Github Action, Metabase, and Looker Studio. Experience in face to face client interactions. Good understanding of Software development methods like Agile, strong ability to lead and deliver projects single-handedly, excellent analytical and communication skills and willingness to understand new business/technical areas.

Experience

Dew solutions pvt ltd

Senior Software Engineer

Mar 2023 – Present · 3 yrs 1 mo

Data Lake
● Working on optimizing current Architecture for CDC data flow to S3 and then Redshift using EMR, Lambda and MWAA which help in around 40% of cost reduction.
● Worked on ETL pipeline designing using AWS Glue, Lambda, python for new sources which were added to Data lake which is presently built on S3 and Redshift.
● Databricks POC for current architecture.
● In house Data Quality Check framework using AWS
Deeque and hosted on AWS using Athena,EMR and Airflow etc.
Beauty
● Different Recommendation jobs like Beauty ID Based,
Recent Purchase Based, Browse Based Recommendations etc. Pipeline consists of common modules and CI/CD Pipeline using Github Action, Terraform, Event bridge SNS, Step functions and Glue Job to run the Spark Job based recommendations and after that relevant ranks for a particular feed is predicted.
● Handled Apache NiFi related ingestion job to data lake and then to Redshift Warehouse which consist of different services like Profile service, User interaction service etc.
● Multi Arm Bandit ML based Recommendation for feed generation using recent purchase and browse based data.
Beauty POS
● Kafka consumer using lambda function.
Order Fact Table to maintain all the offline store sales and transactions.

AWSEMRLambdaRedshiftAirflowPython+4

Customerglu

Data Engineer

Mar 2022 – Mar 2023 · 1 yr · Bengaluru, Karnataka, India

● Optimized existing client specific pipeline to event specific pipeline and also combined staging clients to common kinesis stream.
● Co-Developed a near real-time analytics system using AWS Kinesis, AWS Lambda and AWS Redshift Data Warehouse.
● Developed the Redshift database system to maximize the query performance by using relevant Sort keys ,Distribution keys and writing Materialized Views queries for near real time reporting.
● KCL based consumers (API) that dumps data to the dashboard received in the last 30 min.
● Over buffered reward api failing to process events implemented retry and DLQ and fail request reduced to zero.
● Worked on Business Intelligence tools like Looker Studio and Metabase for getting Insights from data and taking appropriate decisions based on insights.
● Worked on Cloud Cost Optimization by applying Incremental read on analytics Glue Jobs . Which helped in bringing down cost by 75%.

AWS KinesisAWS LambdaAWS RedshiftLooker StudioMetabaseData Engineering+1

Crowdanalytix

Associate Software Engineer

Aug 2019 – Mar 2022 · 2 yrs 7 mos · Bengaluru, Karnataka, India

● SIG-Image Captioning: PyTorch model converted into tenorflow using ONNX deployed on GCP TensorRT and TF-Serving interacting with Flask App
● Material Bank: Django project, TF Serving Celery Redis server based applications- Recolour User API for detecting background and recolouring, color palette API for hex-code and colors, Scale Trax API for distance measurement.
● Data-Ew Wrapper And HDS Supply : Django middle-ware for automating CSV file and outputting in required JSON format using Celery & Redis server
● IoT device data population to IBM Watson using NodeRed
● Bharat Paper Scanner: Click a picture convert it into PDF, Have capability of Image filter cropping,OCR,multi Language translation with TTS. Using Tesserct.js, Ionic4, TTS, Google language translate
Play store: Bharat Paper Scanner (com.eyescan.aaa)

PyTorchTensorFlowDjangoNodeRedMachine LearningWeb Development

Creative flakes communication llp

Devloper Intern

Dec 2016 – Feb 2017 · 2 mos · NAINITAL

I am working as devlopment intern in which I am using Ionic2 for hybrid mobile app devlopment.

Ionic

Internshala

Intern

Nov 2016 – Dec 2016 · 1 mo · Nainital

I am learning python graphics library and how to use for different purposes.After completing this training I will able to make my own games using python.
Project:
Mario Game using python.

Python