Akarsh Srivastava — Co-Founder

🚀 Lead Data Engineer | Databricks | PySpark | Airflow | AWS | Data Lakehouse ArchitectWith over 9 years of experience in designing and scaling modern data platforms, I specialise in building robust, end-to-end data pipelines that drive actionable insights and real-time decision-making. I've had the privilege of contributing to high-growth organisations like Adobe, CRED, and Paytm, where I led initiatives across web analytics, personalisation, merchant platforms, and financial data domains.My expertise lies in blending cutting-edge technologies with business-first thinking to build scalable, resilient, and efficient data systems — from raw ingestion to insights delivery.🔧 Key Areas of Expertise:Big Data Engineering: PySpark, Apache Spark, Kafka, Hadoop, HDFSData Orchestration & ETL: Apache Airflow, Databricks Workflows, SQL, PythonCloud & Warehousing: AWS EMR, S3, Redshift, Data Lakehouse (Delta Lake)Analytics & Visualisation: Tableau, Power BI, Real-Time Monitoring FrameworksData Modeling: Dimensional Modeling, Data Vault, Scalable DataMart DesignLeadership: Managing teams, mentoring junior engineers, driving cross-functional projectsKey Achievements:- Migrated enterprise-scale data warehouses to Databricks, increasing query performance by 40% and reducing costs.- Designed real-time data frameworks and alerting systems that improved personalization and operational efficiency.- Led cross-functional teams to deliver complex analytics solutions, mentoring junior engineers and fostering a culture of technical excellence.I thrive in complex data ecosystems and take pride in building pipelines and platforms that are not only scalable but also self-healing, observable, and future-ready.📬 Let’s connect if you’re looking to exchange ideas around data engineering, cloud architecture, or building impactful data-driven solutions.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech sectors.

Location: Bengaluru, Karnataka, India

Experience: 10 yrs 3 mos

Skills

Data Engineering
Aws
Apache Spark
Data Warehousing

Career Highlights

Migrated enterprise-scale data warehouses to Databricks.
Designed real-time data frameworks improving personalization.
Led cross-functional teams delivering complex analytics solutions.

Work Experience

Advance Auto Parts

Lead Data Engineer (8 mos)

Adobe

Senior Data Engineer (1 yr 1 mo)

CRED

Senior Data Engineer (2 yrs 5 mos)

Paytm

Data Engineer (4 yrs 1 mo)

QorQl

Product Analyst (10 mos)

Restropedia

Co-Founder (1 yr 2 mos)

Research Design and Standards Organization

Intern (2 mos)

Education

Bachelor of Technology (B.Tech.) at Dr. A.P.J. Abdul Kalam Technical University

Akarsh Srivastava

Co-Founder

Bengaluru, Karnataka, India10 yrs 3 mos experience

Key Highlights

Migrated enterprise-scale data warehouses to Databricks.
Designed real-time data frameworks improving personalization.
Led cross-functional teams delivering complex analytics solutions.

Stackforce AI infers this person is a Data Engineering expert in SaaS and Fintech sectors.

Contact

Skills

Core Skills

Data EngineeringAwsApache SparkData Warehousing

Other Skills

Amazon Elastic MapReduce (EMR)Amazon Web Services (AWS)Apache AirflowAzure databricksBig DataBusiness AnalysisBusiness Intelligence (BI)DQSData AnalysisData ModelingData VisualizationDatabasesDatabricksDomain ArchitectureExtract, Transform, Load (ETL)

About

Experience

10 yrs 3 mos

Total Experience

1 yr 11 mos

Average Tenure

8 mos

Current Experience

Advance auto parts

Lead Data Engineer

Oct 2025 – Present · 8 mos · Hyderabad, Telangana, India · Hybrid

Data EngineeringPython (Programming Language)Amazon Web Services (AWS)AWS

Adobe

Senior Data Engineer

Aug 2024 – Sep 2025 · 1 yr 1 mo · Bangalore · Hybrid

Architecting and implementing scalable data lakehouse solutions on AWS and Databricks.
Leading the development of real-time analytics pipelines for Adobe’s core products, supporting millions of users.
Mentoring a team of engineers and collaborating with cross-functional stakeholders to deliver business-critical insights.

Apache SparkApache AirflowAzure databricksPySparkDomain ArchitectureData Engineering

Cred

Senior Data Engineer

Mar 2022 – Aug 2024 · 2 yrs 5 mos · Bengaluru, Karnataka, India · On-site

Designed and implemented end-to-end data pipelines/ETL, including requirement gathering, design, development, and implementation.
Led successful migration of data from AWS Redshift to Databricks, including the migration of datamarts to Databricks SQL and Notebook.
Developed a robust data sanity framework to ensure data accuracy and consistency across source and destination storage.
Worked on creating a event-based NRT alerting and data pipeline framework for a personalisation DS model.

Apache AirflowApache SparkAmazon Web Services (AWS)Data ModelingData WarehousingDatabricks+5

Paytm

Data Engineer

Feb 2018 – Mar 2022 · 4 yrs 1 mo · Noida, Uttar Pradesh, India · On-site

Built end-to-end data solution from requirement gathering, design, modeling, development and implementation.
Created a framework using Pyspark and Kafka for streaming real-time data requests from the merchants using merchant Panel.
Migrated from AliCloud to AWS services and used Spark-Scala for creating OLAP on EMR.
Developed Python automated HTML reports by querying data stored in HDFS using Hive to be sent to the senior management for analysis of the daily progress of the businesses.
Setup a real-time financial data-based ETL process that pushes data to the merchant app through API using MySQL and HiveSQL.
Highly experienced in the use of Hive queries to analyze the data stored in HDFS. Worked on HDFS space optimization tracking file size and memory consumed per user using PySpark.
Developed and deployed real-time ETL pipelines supporting 1M+ merchant transactions daily.
Automated reporting processes that saved 20+ hours per week for the finance team.
Created a functionality using Python and MySQL to report users who used transactional information for any fraudulent activities.
Developed UNIX shell scripts to set up automated monitoring.
Managed payouts and settlement reports for the finance team stored in ODPS, an Alibaba product.
Followed Agile Scrum methodology.
Worked with the operations strategy team to evaluate and enhance the performance of the payments business.
Developed advanced and efficient Hive and SQL query logics for data analysis and investigation.

HadoopAmazon Web Services (AWS)PySparkSQLData WarehousingData Modeling+1

Qorql

Product Analyst

Apr 2017 – Feb 2018 · 10 mos · Noida, Uttar Pradesh, India

Systems Update, Technical Analysis, Report Generation & Charting. Analyze the client’s requirements and processes through document analysis and feedback.
Demonstrate excellent troubleshooting and problem-solving skills.
Liaise between business and technical personnel to ensure a mutual understanding of processes and applications.