Himanshu Jain

Data Engineer

Bengaluru, Karnataka, India5 yrs 10 mos experience
Most Likely To Switch

Key Highlights

  • Reduced cloud costs by 50% through optimizations.
  • Improved data accuracy by 40% in ETL processes.
  • Mentored teams, boosting productivity by 10%.
Stackforce AI infers this person is a Data Engineer specializing in Fintech and SaaS with a focus on high-performance data pipelines.

Contact

Skills

Core Skills

Data EngineeringEtl DesignCloud OptimizationCloud Services

Other Skills

AWSAlgorithmsAmazon RedshiftApache AirflowAzure Data FactoryAzure Data LakeBig DataCC++CPPComputer ScienceContinuous Integration and Continuous Delivery (CI/CD)CybersecurityData AnalyticsData Architecture

About

Data Engineer with 5+ years of experience designing, scaling, and optimizing high-volume, low-latency data pipelines across Finance, Retail, and Trading domains. Proven track record in cutting pipeline runtimes by 50%, reducing cloud costs by 50%, and improving data accuracy by 40%. Specialized in building real-time streaming platforms using Apache Spark, Kafka, PySpark, and Databricks, with deep expertise in AWS, GCP, Airflow, and Delta Lake architectures. Experienced in architecting fault-tolerant distributed systems, ensuring regulatory compliance (SEBI, GDPR), and enabling data-driven decision-making for 10M+ customers. Passionate about solving complex data challenges, mentoring teams, and delivering measurable business impact through modern data engineering practices. Core skills: Data Modeling | ETL Design | Distributed Computing | AWS | GCP | Spark Streaming | CI/CD | Data Lakehouse

Experience

Angel one

Senior Data Engineer

Jan 2024Present · 2 yrs 2 mos · Bengaluru, Karnataka, India · Hybrid

  • Architected real-time pipelines on Databricks with Kafka & PySpark for 10M+ customers, enabling scalable UPI, banking, and equity data processing.
  • Reduced data processing time by 20% via ETL optimization; built Data Quality Check framework validating 700+ tables daily.
  • Tuned Redshift & PySpark jobs to improve performance by 40%, minimizing duplicate data via Delta Lake schema evolution.
DatabricksKafkaPySparkETL optimizationData Quality CheckRedshift+3

Walmart global tech

Data Engineer III

Sep 2023Dec 2023 · 3 mos · Bengaluru, Karnataka, India · On-site

  • Cut data processing time complexity by 70% and cloud costs by 50% using GCP optimizations.
  • Integrated real-time ingestion with Kafka, Spark, and Scala, enabling agile decision-making.
  • Implemented audit tables and incremental validation, ensuring high data integrity.
GCPKafkaSparkScalaData integrityData Engineering+1

Target

Engineer - Big Data

May 2022Sep 2023 · 1 yr 4 mos · Bengaluru, Karnataka, India · On-site

  • Delivered 30% faster and 40% more accurate ETL pipelines using Spark, Kafka, Hive, and SQL.
  • Built Data Correction Framework fixing 500K+ historical records, reducing errors by 20%.
  • Migrated Hive workflows to Spark, reducing query latency by 25%.
SparkKafkaHiveSQLData Correction FrameworkData Engineering+1

Tekion corp

Associate Software Engineer

Jan 2020May 2022 · 2 yrs 4 mos · Bangalore Urban, Karnataka, India

  • Designed and deployed 30+ scalable ETL pipelines and 80+ Python APIs using AWS (Boto3, Lambda, API Gateway), Docker, and SQL — accelerated data processing by 50% and improved accuracy by 30%.
  • Engineered and optimized 40+ Apache Airflow DAGs for automated ETL, integrating AWS Redshift, PostgreSQL, and EDWs, cutting pipeline runtime by 50%.
  • Built Python-based data quality monitoring and alerting systems, improving data integrity by 35% and ensuring GDPR compliance.
  • Drove CI/CD automation, Tableau-based analytics, and Razorpay payment integration — increasing transaction success rates and system efficiency by 20%.
  • Mentored interns on AWS, SQL, ETL best practices, and Airflow, boosting team productivity by 10%.
AWSDockerSQLApache AirflowPythonData Engineering+1

Education

GL Bajaj Institute of Technology and Management

Bachelor of Technology - BTech — Computer Science

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Data Engineering & Etl Design

Explore similar profiles based on matching skills and experience