Ankur Manna

Data Engineer

New Delhi, Delhi, India8 yrs experience

Key Highlights

  • Expert in building data pipelines for major tech companies.
  • Proven track record in optimizing big data applications.
  • Strong experience in cloud platforms and data engineering.
Stackforce AI infers this person is a Big Data Engineer with expertise in Fintech and Retail sectors.

Contact

Skills

Core Skills

Data ArchitectsPython (programming Language)Apache SparkGoogle Cloud Platform (gcp)Sql

Other Skills

AWSAd TechAdtechApache AirflowApache Spark GraphXApache Spark MLBig DataBig Data AnalyticsCassandraData MigrationData ModelingData StructuresData WarehousingDatabricks ProductsDistributed Systems

About

Currently working as a big data developer at Tata Consultancy Services for a reputed German client in the banking domain. Experience in the Big data technologies using tools and services like Apache Spark, PySpark, Apache Hive and HDFS. Hands On experience of Analysis, Design, Coding and Testing phases of Software Development Life Cycle. Looking forward to work for an organization that offers a positive atmosphere to learn and implement new skills and technologies for both personal and organizational growth.

Experience

Rategain

Senior Data Engineer

Mar 2025Present · 1 yr · Noida · Hybrid

Data ArchitectsPython (Programming Language)Databricks ProductsGoogle Cloud Platform (GCP)Ad TechAdtech

Epam systems

Senior Software Engineer

Feb 2024Jun 2025 · 1 yr 4 mos · Hyderabad, Telangana, India

Apple

Data Engineer

Jul 2022Feb 2024 · 1 yr 7 mos · Hyderabad, Telangana, India

  • Apple Maps
  • Role: Big Data Engineer/Software Engineer
  • Project Undertaken: Building data pipeline and to automate the apple maps building
  • process.
  • Key Highlights:
  • Working on Naming and Addressing build pipelines which shall provide
  • correct data for roads and addresses to users for navigation.
  • Challenges Faced: (a) Optimize a legacy scala spark application to improve
  • performance to reduce runtime by 70-80% (b) Develop a complex spark
  • application to detect turbo roundabouts to solve navigation issues for apple
  • maps users.
  • Technologies Used: (a) Apache SPARK, Hadoop, Cassandra, Scala, AWS,
  • Python, Shell scripting
RddApache Spark GraphXFusionxPySparkGitPython (Programming Language)+6

Unify technologies

Software Development Engineer

Jul 2022Feb 2024 · 1 yr 7 mos · Hyderabad, Telangana, India

  • Data Engineer(SDE)
HadoopGitMapReducePython (Programming Language)Extract, Transform, Load (ETL)Apache Spark+3

Dunnhumby

Data Engineer

Oct 2021Jun 2022 · 8 mos · Gurugram, Haryana, India

  • Role: Big Data Engineer/Software Engineer
  • Project Undertaken: Building data pipeline to allocate promotional offers to
  • customers of retail business(clients) like Tesco(On Premise: Cloudera),
  • Wakefern(Cloud: GCP), etc. based on relevancy for a given customer and filtration
  • criteria of a particular event/campaign.
  • Key Highlights:
  • Working on allocation engine to allocate offers according to customer
  • behaviour over the past 8-52 weeks and filtration criteria of a particular
  • event/campaign for a given market.
  • Challenges Faced: (a) Optimize Spark Scala application part of the Allocation
  • data pipeline. (b) Develop a complex allocation engine using Pyspark Graphx
  • libraries to allocate offers to customers based on their ranking and slot
  • availability.
  • Technologies Used: (a) Apache SPARK, Apache Airflow, Hadoop, Hive, Scala,
  • GCP, Python, Shell scripting
Google Cloud Platform (GCP)GitHiveExtract, Transform, Load (ETL)SQLLinux+1

Tata consultancy services

Big Data Developer

Jul 2019Sep 2021 · 2 yrs 2 mos · Bengaluru, Karnataka, India

  • Role: Big Data Engineer/Software Engineer
  • Project Undertaken: Building MIS-Calc Engine’s Data Pipeline for Deutsche Bank’s
  • Mortgage and Home Saving Loan accounts
  • Key Highlights:
  • Successfully extracted and processed data from a Data Vault Model based
  • filesystem using PySpark library functions and created Data Mart for reporting.
  • Successfully tuned the spark jobs for optimum performance using spark
  • configurations for shuffle partitions.
  • Challenges Faced: (a) Big Data Storage and processing (b) Pipeline Scheduling
  • and Automation (c) Creation of staging environments to optimise the overall
  • data processing (d) Creation of a logging framework and control the level via
  • command line arguments (e) Handling Component Failures.
  • Technologies Used: Apache SPARK, Hadoop, Hive, Python, Shell scripting
GitHiveExtract, Transform, Load (ETL)SQLLinuxDistributed Systems+1

Kalyani government engineering college 102

2 roles

Event Coordinator

Mar 2018Apr 2018 · 1 mo

  • I successfully organized a seminar on Cyber Security Trends in collaboration with Cyber Security Knowledge and Research Sharing Council.
  • I also coordinated a Hackathon event named Capture-The-Flag at Espektro 2k18 in collaboration with Cyber Security Knowledge and Research Sharing Council.

Assistant Network Engineer

Jan 2018Jun 2019 · 1 yr 5 mos

  • Managing Network Systems under Network Administrator/Professor's guidance for Kalyani Government Engineering College and R.B.C Hall Hostel.

Education

KALYANI GOVERNMENT ENGINEERING COLLEGE 102

Bachelor of Technology - BTech — Electrical Engineering Technologies/Technicians

Jan 2015Jan 2019

Stackforce found 100+ more professionals with Data Architects & Python (programming Language)

Explore similar profiles based on matching skills and experience