Govind Kumar

Product Engineer

Bengaluru, Karnataka, India9 yrs 10 mos experience

Highly Stable

Key Highlights

Over 10 years of experience in data engineering.
Expert in building scalable data infrastructure.
Proven track record in real-time data processing.

Stackforce AI infers this person is a Data Engineering expert specializing in cloud-based solutions across multiple industries.

Contact

Skills

Core Skills

Data EngineeringCloud InfrastructureEtl ProcessesData AnalyticsData Analysis

Other Skills

AWSAWS GlueAWS LambdaAirflowAlterianAmazon Elastic MapReduce (EMR)Amazon FirehouseAmazon KinesisAmazon RedshiftAmazon S3Amazon Web Services (AWS)AnacondaApache AirflowApache KafkaApache Spark Streaming

About

* Involved in building scalable infrastructure in data engineering domain with more than 10+ years of experience. * Have worked in different domain like Retail , Edu-Tech , Healthcare ,Telecommunications and Video conferencing and Oil and Petroleum. * Have worked in challenging environments and delivered the project using technology below tech stack: Data Processing :- AWS Kinesis Firehose, Apache Flink, PySpark and Python Message Queue Systems: Apache Kafka and Google Pub/Sub Data Storage & Databases :- Redshift, MySQL / MariaDB, SQL Server, SingleStoreDB / MemSQ ,MongoDB,DynamoDB and Cassandra Data Lake :- Apache Iceberg and Delta Table, AWS S3 and GCS IAC : Terraform Orchestration & Workflow Management :- Apache Airflow Cloud Platforms :- AWS (S3,MSK, Firehose, Redshift, DynamoDB, Lambda, S3, SQS etc.) and GCP(GCS, Big-query, Data-Flow and DataProc) BI & Analytics :- Tableau (Admin/Developer) Marketing & CRM Tools :- LeadSquare, AppsFlyer

Experience

Pdi technologies

Lead Data Engineer

Oct 2023 – Nov 2025 · 2 yrs 1 mo · Bengaluru, Karnataka, India · Hybrid

Data Platform: Responsible for designing and developing the roadmap for data flow for real time pipeline to
upgrade the existing tech stack from on premises SQL Server to Cloud i.e.AWS using different AWS services
Consumers: Enable the real time data streaming for Data Scientists/Data Analytics team to consume data in more reliable and purest form for features Store and feed to Sagemaker for Forecasting, Predictive Modeling & BI-Layer
Tools and Technology Used: MSK (Managed Kafka Service), Debezium Connector, Firehouse Data Stream, Lambda,EMR, EC2, S3, Python, Pyspark, Delta Table, Redshift, DynamoDB, Iceberg, VPC, Subnet, Jira, Delta table, Pytest, Flink etc.

AWSPythonPysparkKafkaRedshiftDynamoDB+5

Verizon

Engineer-||| Consultant - Data Science

Oct 2020 – Oct 2023 · 3 yrs · Banglore · Hybrid

Serverless ETL using Glue: Migrated/Created the ETL built on EC2 instances to the serverless using AWS Glue and monitored and triggered by Apache Airflow which does the cost reduction by 40-45 %
Enhanced ETL Performance: ETL job execution performance enhanced drastically while using Pyspark connectors for extracting data from salesforces by 8x to 10x for few jobs.
Real Time Data Pipelines: Worked on real time data pipeline using Kafka stream, EMR with Auto-Scaling and store in S3 as Data Lake which size around 300 Tb.
ETL and Pipeline Migration: Migrated/created Real-Time jobs and Batch jobs from Spark 2.x and python 2.x to Spark 3.x and Python 3.x in serverless environment for cost saving and performance efficiency.
Tools and Technology Used: Python, Pyspark, SparkSQL, Kafka, Data Lake, EMR, Airflow, Tableau, AWS Redshift, Glue, SQS, S3, Lambda, DynamoDB, Athena, Spectrum, Code Commit, GCP, Big Query, Domo

AWS GluePysparkKafkaAirflowTableauRedshift+4

Byju's

Senior Data Engineer

Jun 2019 – Oct 2020 · 1 yr 4 mos · Bengaluru, Karnataka, India · On-site

Develop, construct and maintain architectures
with business requirements
Create Data pipeline for different business requirements
Data warehousing,Data Modelling
Develop data set processes
Use programming language and tools for ETL
Identify ways to improve data reliability, efficiency and quality
Deliver end to end data solutions
Use large data sets to address business issues
Deploy sophisticated analytics programs, machine learning and statistical methods
Prepare data for predictive and prescriptive modelling
Handling a team of 5 data engineers
Find hidden patterns using data
Use data to discover tasks that can be automated
Deliver updates to stakeholders based on analytics
Reporting-dash boarding and story telling using Tableau and Domo

Data WarehousingETLTableauData ModelingMachine LearningData Engineering+1

Innovaccer

Senior Data Engineer

Feb 2019 – Jun 2019 · 4 mos · Noida, Uttar Pradesh, India · On-site

Cartesian consulting

2 roles

Data Engineer

Promoted

Dec 2016 – Feb 2019 · 2 yrs 2 mos

Design schema ER diagram, implement business logic in technical terms
Develop and implement Common Data Model for different clients
Develops and design the customer life cycle Management Engine to enhance customer behaviour and send personalised communications
Develop and maintain ETL job using pentaho
Data migration from one platform to another platform
Creating stores procedures, triggers , functions and views to meet the requirements
Used pandas, numpy, matplotlib and scipy
Deliver End to End data driven decision
Interact with client directly and deliver the solutions in the given timelines

PentahoData MigrationETLData Engineering