Shashank N.

Data Engineer

Bengaluru, Karnataka, India10 yrs experience

Highly Stable

Key Highlights

9+ years of experience in data engineering.
Expertise in real-time data pipelines and cloud platforms.
Strong background in Fintech and trading ecosystems.

Stackforce AI infers this person is a Fintech Data Engineer with expertise in real-time data processing and cloud solutions.

Contact

Skills

Core Skills

Google Cloud Platform (gcp)Apache SparkApache KafkaStreaming SparkSpring BootMongodbApache FlinkPower BiVerticaCore Java

Other Skills

TableauData WarehousingScalaDruidSpring BatchDockerKubernetesJavaApache CamelRedisJIRAPythonSciLearnGradleMaven

About

Data Engineer with 9+ years of experience designing high-performance real-time pipelines, cloud data platforms, and streaming architectures across Fintech and high-volume transactional domains. Experienced in building scalable ingestion systems for financial events, pricing data, settlements, reconciliations, and time-series analytics. Strong exposure to trading and crypto ecosystems—market-data ingestion, funding-rate computation, PnL tracking, and programmatic trade automation. Deep expertise in Spark, Airflow, BigQuery/Hudi, distributed data engineering, and low-latency pipelines. Known for delivering resilient, cost-efficient data lakehouse solutions, automating workflows, and enabling data-driven decision-making for large enterprise and financial systems.

Experience

10 yrs

Total Experience

5 yrs

Average Tenure

5 yrs

Current Experience

Walmart global tech india

Software Engineer III

May 2021 – Present · 5 yrs · Bangalore Urban, Karnataka, India

Implementing a framework for reconciliation of data flowing from source to SAP.
Implementing checks - file frequencies, sequences, amount level check, etc.
Designing the framework to be flexible enough to accommodate multiple Sources with varying schema. • Generate reports on top of the aggregated reconciliation status using Big Query and Tableau.•

Google Cloud Platform (GCP)TableauData WarehousingApache SparkScala

Cognizant

6 roles

Senior Developer

Promoted

Jul 2019 – May 2021 · 1 yr 10 mos

Telecom - Security Operation Center
Responsible to develop application which can detect security threats from live internet traffic in an organisation .
Responsible to develop Streaming Spark Application for data Ingestion and Enrichment via Apache Kafka and Druid.
Developing and Testing Rest APIs using Spring Boot, Junit , Mockito.
Creating Oozie workflows, scheduling deploying in Hadoop.

Programmer Analyst

Jan 2018 – Jun 2018 · 5 mos

Retail - ATG to SpringBoot Micro Services and MongoDB Migration
Agile Retail project involves migrating Oracle ATG batch jobs to open source
technologies using Spring Boots , Spring Batch, Mongo DB , Spinnaker , Docker KUBERNETES and JIRA.
Responsibilities-
Developing modules using open technologies like - Core Java, Spring Boots , Spring Batch , MongoDB . Implementing Batch Jobs ,Data Modeling for MongoDB and Developing Dataloaders for loading data from ATG to MongoDB.
Unit Testing and Integration Testing of the Modules using Junit 4.12.
Building and Deploying the modules using Spinnaker ,Docker and KUBERNETES. Communicating with the Team and the Client ,the daily progress of the work.

Programmer Analyst

Apr 2017 – Dec 2017 · 8 mos

Customer Care Service
Cognizant RAI COE Solution
Telecom project that involved interacting with real time data getting generated when ever there was a problem in the network. Hence detecting outages in the particular area and notifying the service provider to take necessary steps to resolve the issue .
Responsibilities-
Developing modules using open technologies like - Java , Apache Flink , Apache Kafka ,Apache Camel, Redis , MongoDB and making dashboards using Metabase.

Programmer Analyst Trainee

Jan 2017 – Mar 2017 · 2 mos

Supply Chain Management Automation
Project involved migrating from Oracle to Hp Vertica database and finding
business insights about the Supply Chain Management Process using analytics dashboards.
Responsibilities-
Understanding the requirements from the customer.
Writing queries in Vertica vsql .
Preparing Dashboards in PowerBI.
And performing analytics over the aggregated Data .
Installing and Maintaining Vertica Nodes and associated packages. Reporting the progress of the work to the team and the client.

Programmer Analyst Trainee

Jul 2016 – Dec 2016 · 5 mos

DigiCare
Cognizant RAI COE Solution
Project involved interacting with user's health devices.Using the information to do a Complex Event processing and send notification to the user in real time if there is an Alert.
The project also involved integration with Pega and was a part of PegaWorld 2017
Responsibilities-
Preparing the Requirement and Design documents .
Developing Modules using open technologies like Apache Flink , Apache Kafka . Core Java , Mongo DB ,Redis.
Communicating with Pega team for the progress of the work.
Handling DevOps on AWS