Ashish Patel

Software Engineer

Bengaluru, Karnataka, India8 yrs 3 mos experience
Most Likely To Switch

Key Highlights

  • 6+ years of experience in Big Data engineering.
  • Contributed to Apache Airflow and other open-source projects.
  • Expert in building scalable data pipelines across cloud platforms.
Stackforce AI infers this person is a Big Data Engineer with expertise in cloud-based data solutions.

Contact

LinkedIn

Skills

Core Skills

Big DataCloud ComputingData Engineering

Other Skills

Apache SparkData PublishingApache AirflowWorkflow AutomationScalaJavaDistributed SystemsData LakesDatabricksPythonAmazon Web Services (AWS)Google Cloud Platform (GCP)Python (Programming Language)MapReduceApache Impala

About

Experienced Software and Big Data Engineer with 6+ years of experience in Java, Scala, Python, and Big data and Distributed engineering, seeking to apply my abilities to contribute and build something productive. I love contributing to Open-source projects and am a contributor to Apache Airflow and other Open source projects.

Experience

8 yrs 3 mos
Total Experience
2 yrs
Average Tenure
5 yrs 3 mos
Current Experience

Oracle

Principal Software Engineer (PMTS)

Feb 2025 – Present · 1 yr 3 mos · Bengaluru, Karnataka, India

  • Building Oracle Datashare, a Spark-based data publishing service to move datasets from Oracle Cloud (OCI) to different sinks(Delta/Iceberg/Azure/Snowflake etc.) in different Cloud providers, supporting schema evolution, compaction, partitioning, and job observability via Oracle’s Job Management Console (JMC).
Apache SparkData PublishingCloud ComputingBig Data

Prophecy

Staff Software Engineer (Big Data)

Jan 2023 – Dec 2024 · 1 yr 11 mos · Bengaluru, Karnataka, India · On-site

Big DataApache SparkScalaApache AirflowData LakesDatabricks

Skyscanner

Software Engineer 2 (Data Platform)

Dec 2021 – Jan 2023 · 1 yr 1 mo · Greater London, England, United Kingdom

Apache SparkApache AirflowDistributed SystemsDatabricksPythonJava+2

The apache software foundation

Contributor - Apache Airflow

Feb 2021 – Present · 5 yrs 3 mos

  • Contributing to Apache Airflow
  • Apache Airflow is a workflow automation and scheduling system that can be used to author and manage data pipelines.
  • Contributions - https://github.com/apache/airflow/commits?author=pateash
Apache AirflowWorkflow AutomationData Engineering

Walmart global tech

Software Engineer III (Big Data)

Feb 2021 – Nov 2021 · 9 mos · Bengaluru, Karnataka, India

  • Part of the supply chain technology team, and working on cutting edge forecasting solutions to enable the everyday low-cost philosophy of Walmart.
  • Building High-Quality Scalable ETL Frameworks to build our Forecasting Pipelines.
  • Migrating our On-Prem Hadoop Clusters to Google Cloud Platform as part of a strategic partnership with Google.
  • Reduced Dataproc cluster cost by 60% via optimizing Airflow DAG workflows having sensors and report generation Tasks.
Apache AirflowApache SparkDistributed SystemsJavaGoogle Cloud Platform (GCP)Big Data+1

Deutsche bank

2 roles

Senior Software Engineer

Promoted

Jan 2020 – Feb 2021 · 1 yr 1 mo · Pune, Maharashtra, India

  • Worked As Senior Software Engineer in CIB division for Volcker Project.
  • We Developed Data pipelines for our Reporting Batch jobs handling Terabytes of data every day across hundreds of Spark and Hadoop MapReduce ETL jobs.
  • Optimized the End to End Pipeline execution time to comply with Regulatory SLA in accordance with new Volcker2.0 regulatory Norms.
  • Worked on Google Cloud Platform to plan and migrate our On-Premise Cluster and Jobs to GCP.
ScalaApache SparkJavaMapReduceApache ImpalaHadoop+5

Software Engineer

Jul 2018 – Jan 2020 · 1 yr 6 mos · Pune, Maharashtra, India

  • Worked in CIB for Regulatory Transaction Reporting
  • We developed Platform simplification for Informatica jobs using Java, Spring + Reactor Framework with Oracle Database.
DatabasesComputer ScienceSpring Framework

Medium

Tech Blogger

Jul 2018 – Present · 7 yrs 10 mos · Remote

  • Helping People around Big Data, Backend and Competitive Programming.
  • My articles have got more than 200K+ reads so far.
Cloud ComputingApache AirflowScalaApache SparkJavaDistributed Systems+1

Maulana azad national institute of technology

Research Assistant

Sep 2017 – Feb 2018 · 5 mos · Bhopal, Madhya Pradesh, India

  • Co-written A Comparative Study of Music Recommendation Systems with Prof. Rajesh
  • Wadhvani.
  • Presented the Paper in IEEE seminar and won best paper award.
  • This paper describes different recommendation strategies and compares their
  • practicality on mobile devices.
  • Evaluated and Compared different Recommendation Strategies by training different ML models.
  • ref-https://ieeexplore.ieee.org/document/8546852
Computer Science

Carwale

Summer Intern

May 2017 – Jul 2017 · 2 mos · Mumbai Area, India

  • Developed real-time event tracking and analysis framework using Apache Spark and Cassandra NoSQL database along with Python Flask Web framework.
FlaskApache Spark StreamingApache SparkPython (Programming Language)Cassandra

Education

Maulana Azad National Institute of Technology (MANIT), Bhopal

Bachelor’s Degree — computer science and engineering

SCA Bhopal

Computer Programming (Advanced Java and C++ Programming)

Jan 2014 – Jan 2016

I.P.S Academy, Bhind

Higher Secondary — Science

Jan 2012 – Jan 2013

I.P.S Academy Bhind

High School — Science

Jan 2010 – Jan 2011

Stackforce found 100+ more professionals with Big Data & Cloud Computing

Explore similar profiles based on matching skills and experience

Arindam Das

Arindam Das

Senior Data Engineer

at Tata Consultancy Services

Delhi, India10 yrs 5 mos exp
Puneet Arora

Puneet Arora

Software Engineering Lead

at UnitedHealth Group

Noida, India6 yrs 1 mo exp
SG

Saurabh Gulati

Mission Critical Engineer

at Schuberg Philis

The Randstad, Netherlands13 yrs 4 mos exp
Aravinth Bheemaraj

Aravinth Bheemaraj

AI/Data Architect

at Tarento Group

Coimbatore, India17 yrs 5 mos exp
Natural Language Processing (NLP)Large Language Models (LLM)Machine Learning
Ajay Sharma

Ajay Sharma

CTO, Ezeehealth

at Dual Mirror Healthcare

Bengaluru, India20 yrs 7 mos exp
Cloud ComputingData Analytics
DD

Deepak Diwakar

Co-Founder

at Mindtickle

Pune, India17 yrs 11 mos exp
Product DevelopmentMachine LearningAnalyticsHadoopDistributed Systems
Rahul Tanwani

Rahul Tanwani

Founder

at Stealth Mode Startup

India10 yrs 1 mo exp
Artificial Intelligence (AI)Machine Learning
Kriti Mittal

Kriti Mittal

Senior Engineer

at Fractal

Bengaluru, India7 yrs 8 mos exp