Rupal Gakkhar

Data Engineer

Bengaluru, Karnataka, India8 yrs 7 mos experience
Most Likely To Switch

Key Highlights

  • 7 years of experience in Generative AI and Big Data.
  • Expert in ETL development and data migration to Snowflake.
  • Strong background in performance optimization for data processing.
Stackforce AI infers this person is a Big Data and Cloud Technology expert with a focus on ETL and data migration.

Contact

Skills

Core Skills

PythonBig DataEtlHadoop

Other Skills

Apache SparkAutosysBitbucketCICDData MigrationDistributed SystemsExtractGitGit BASHGradleGroovyHiveImpalaJenkinsLoad (ETL)

About

7 Years of IT experience working in Generative AI, chatgpt, Cloud, Big Data applications, ETL development , Reporting and warehousing Technology. ● Developed ETL infrastructure to move data between various database systems. ● Worked on Data Migration project to Snowflake ● Application setup in Snowflake and creating schemas with sentry roles ● Outage handling, postmortem analysis and prevention techniques. ● experienced in designing MPP Data warehouses and complex OLTP workloads. ● Experience of performance optimization in Batch and Near to real time processing applications. ● Experience in reading or debugging code in one or more of the following: Python, Shell, Perl, PySpark,Airflow. ● Understanding of Monitoring , Auditing and Alerting Integration ● Central Logging, monitoring using stacks like Grafana, Prometheus, etc. ● Advanced working SQL experience working with relational databases, query authoring (SQL) and working familiarity with a variety of databases. Technical Expertise : Cloud Technology - Snowflake,Databricks Hadoop Ecosystem: HDFS, Sqoop, Hive, Impala, Spark Database: Greenplum, DB2, Sybase Programming Languages: Python, Shell Scripting. Tools: Autosys, Service Now, GIT, Jira, Nifi

Experience

Visa

2 roles

Staff Data Engineer

Feb 2025Present · 1 yr 1 mo

Senior Data Engineer

Feb 2023Feb 2025 · 2 yrs

  • As part of Payments System Risk team, worked on brand
  • protection programs that involve recovering credit card fraud
  • losses for the issuers and setting certain limits on potential
  • acquirer liability under the Visa Rules.
  • Skills: Python (Programming Language) · Groovy · Jenkins · CICD · Gradle · Shell Scripting · Git BASH · Git · Bitbucket · Distributed Systems · Big Data · Hadoop · Hive ·
Python (Programming Language)GroovyJenkinsCICDGradleShell Scripting+8

Morgan stanley

Manager

Oct 2021Apr 2023 · 1 yr 6 mos · Bangalore Urban, Karnataka, India

Bank of america

Senior Software Engineer

Jul 2020Oct 2021 · 1 yr 3 mos · Mumbai, Maharashtra, India

Tata consultancy services

2 roles

Hadoop ETL Developer

Aug 2018Jul 2020 · 1 yr 11 mos · Pune Area, India

  • Application setup in Hadoop cluster and creating Hive/Impala databases with sentry roles .
  • Requirement gathering from users and Objects creation in Hive with partitioning scheme helpful to users.
  • Used Sqoop tool to import data from various RDBMS (DB2/Sybase) to HDFS .
  • ETL Development with scripts written in Python .
  • 24*7 running jobs to perform incremental load from various RDBMS environment to Hadoop File System

Dataware house Specialist

Aug 2017Jul 2020 · 2 yrs 11 mos · Pune Area, India

  • Worked as team member for project deliveries.
  • High Availability and Disaster Recovery (HADR) setup on OLTP servers and F5 Load Balancing setup across all DW servers.
  • Worked on complex ETL tool to archive data from 8 OLTP’s located globally using federation and export-transform-load logic
  • Automation of Monthly Global Turnover across all Test/QA/QA2/Prod servers.

Education

INDIRA GANDHI DELHI TECHNICAL UNIVERSITY FOR WOMEN

Jan 2015Jan 2017

Stackforce found 100+ more professionals with Python & Big Data

Explore similar profiles based on matching skills and experience