Chandan Kumar Singh

Data Engineer

Bengaluru, Karnataka, India15 yrs 1 mo experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 10+ years in Product Development and Data Engineering.
  • Expert in building real-time data pipelines and machine learning solutions.
  • Proven track record in reducing processing times significantly.
Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech industries.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingMachine LearningSoftware Development

Other Skills

DockerKubernetesPandasGo (Programming Language)GrafanaBig DataHadoopGoogle Cloud DataflowData WarehousingApache SparkExtract, Transform, Load (ETL)Data StructuresApache KafkaSQLPrometheus

About

• Have 10+ years of experience in Product Development. Currently working as Staff Data Engineer in enterprise mobility team. • Experienced with full software development life cycle, building batch and streaming data pipeline solutions, building machine learning and deep learning solutions. • Solid understanding of Data Engineering, Computer Science fundamentals, object-oriented design, data structures, algorithm design, problem-solving, complexity analysis. • Experience on building data pipeline using big data technologies. Worked on building batch and streaming data pipeline for enterprise mobility application, data is being consumed at real time for dash boarding and reporting. • Programming: Python, Golang, C++, C, Linux Shell Scripting, Data Structure, System Design • Data Analysis &Plotting Libraries: Pandas, NumPy, SciPy, Matplotlib • Databases & Connectors: MySQL, ElasticSearch, Cassandra, Kafka Connect, Prometheus • Data Warehouses: Hive, BigQuery, AWS Redshift • Message Queue: Confluent Kafka • Distributed Computation Frameworks: Apache Hadoop, Apache Spark, PySpark • Workflow Management: Airflow • AWS Services: S3, EMR, Lambda, CloudWatch, DynamoDB, Redshift, Athena, Glue, SNS, SQS, Kinesis, StepFunction • GCP Services: DataProc, BigQuery • Backend Framework: Django • Web Development: RESTful, HTML, CSS, NGINX • Dash-boarding & Monitoring Tools: Grafana, Kibana • Build Tools & Containers: Jenkins, Docker, Kubernetes • Control Systems and Documentation: Git, BitBucket, SVN, Jira, Confluence GitHub: https://github.com/chandan3611?tab=repositories Medium.com: https://medium.com/@chandan3611

Experience

15 yrs 1 mo
Total Experience
2 yrs 6 mos
Average Tenure
4 yrs 7 mos
Current Experience

Walmart

2 roles

Staff Data Engineer

Promoted

Jul 2025Present · 10 mos

Senior Data Engineer

Oct 2021Jul 2025 · 3 yrs 9 mos

  • Currently working in enterprise mobility team as data engineer. As part of this team, I worked on designing and developing batch and streaming data pipeline for enterprise mobile data. Processed data is being consumed at real time for reporting. Data is consumed from Kafka topic at real time, processed and stored in BigQuery for real time analysis.
  • Designed and developed batch data pipeline for processing network data, which is consumed for building anomaly detection machine learning model.
  • Designed and developed near real time data pipeline for consuming device data for anomaly prediction. Data is consumed from Kafka topic and used by deep learning model for anomaly prediction.
  • Designed and developed Locus service for devices enrolment in Walmart network and metric collection service for REST API using Golang, Prometheus and Grafana, which is deployed on WCNP.
  • Developed anomaly detection model for modelling behaviour of all store devices. This system consists of multiple ML model detection anomalous behaviour at multiple network stages. LSTM deep learning model for anomaly detection.
DockerKubernetesPandasGo (Programming Language)GrafanaBig Data+16

Jpmorgan chase & co.

Associate Vice President

May 2020Oct 2021 · 1 yr 5 mos · Bengaluru, Karnataka

  • Worked in risk and forecast solution team as data engineer. As part of this team, I worked on designing and developing batch processing data pipeline for risk and forecast solution data using Redshift, EMR, Glue and StepFunction. Pipeline was designed to read data from S3, process it and then store in Redshift. Due to this pipeline processing time was reduced from few hours to 30 mins.
  • Designed and developed data pipeline for processing rule breaches and commentary data using EMR, Glue, StepFunction and S3.
  • Worked on development of multiple services and API to generate various parameters to calculate and analyse risk factors.
  • Developed automated rule engine service to perform automated critical validations and control check on upstream data.
  • Developed machine learning model to replace rule engine service: Classification model to identify rule breaches.
PandasGo (Programming Language)Big DataHadoopAmazon Elastic MapReduce (EMR)AWS Glue+11

Qualcomm

Senior Software Engineer

May 2017Apr 2020 · 2 yrs 11 mos · Bengaluru Area, India

  • Worked in engineering development team, responsible for developing and maintaining gateway software. It can run preconfigured scenario, generate logs, and can also provide first level analysis of logs using machine learning model.
  • This team is also responsible for developing and maintaining various machine learning models for analyzing test logs and providing JIRA ticket recommendation.
  • Accountable for developing multiple features and creating design document for features and optimization in L3 layer.
  • Worked on various machine leaning based solution development as mentioned below.
  • Developed Ticket recommendation system: NLP model that identifies categories of issues and recommend list of solution depending on
  • historic documentation and issues.
  • Developed Log Analysis Tool: Developed machine learning models to analyse all generated logs. This model will detect any deviation
  • from the behaviors exhibited by success logs.
Machine LearningDeep LearningPandasAgile MethodologiesObject-Oriented Programming (OOP)TensorFlow+6

Aricent

Senior Software Engineer

Jun 2016May 2017 · 11 mos · Bangaon Area, India

  • Worked on L3 layer protocols stack feature development for Intel Mobile Communication platform which also involved development of Change Requests and bug fixing.
  • Accountable for developing features and creating design document for features and optimization.
  • Worked on Cell Reselection, IRAT Reselection and Handover feature development.
Agile MethodologiesObject-Oriented Programming (OOP)Data StructuresC (Programming Language)Software Development

Samsung electronics

Lead Engineer

Jun 2014May 2016 · 1 yr 11 mos · Bangaon Area, India

  • Worked on L3 layer protocols stack feature development of Single and Dual SIM Support on Samsung Shannon platform. Responsible for new features development and creating design document for features and optimization.
  • Worked on Layer 3 development for Dual SIM Dual Stack (DSDS).
  • Fixing bugs which are raised by integration, testing team and customers.
  • Worked on Cell Reselection, IRAT Reselection and Handover feature development.
  • Developed camping time optimisation feature. This feature was developed to reduce mobile camping time.
Agile MethodologiesData StructuresC (Programming Language)Software Development

Sasken communication technologies

Software engineer

Jan 2011May 2014 · 3 yrs 4 mos · Bangalore

  • Worked on GSM and Satellite phone protocols stack for Inmarsat Global Satellite Phone Service which also involves feature development and bug fixing.
  • Handling the feature development of Isatpro Phone and Isatpro Phone2.
  • Responsible for performing the activities of on Access-Stratum (AS) Protocol development for mobile domain.
  • Figuring out & fixing the critical bugs on the Protocol Stack which were raised from the integration and testing teams.
  • Carrying out Unit & Integration Testing and preparing design document for High Penetration Paging, National Gateway, and Camping
  • Time Optimization Features.
Agile MethodologiesData StructuresC (Programming Language)Software Development

Education

Texas McCombs School of Business

Post Graduate Program — Artificial Intelligence And Machine Learning

Jan 2019Jan 2020

Great Lakes Institute of Management

Post Graduate Program — Artificial Intelligence and Machine Learning

Jan 2019Jan 2020

Indian Institute of Science (IISc)

Data Analytics and Machine learning

Jan 2017Jan 2018

Rajiv Gandhi Proudyogiki Vishwavidyalaya

BE — computer science & engg.

Jan 2006Jan 2010

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience