Dec 2022 – Jun 2024 · 1 yr 6 mos · Bengaluru, Karnataka, India · Hybrid

• Designed data migration architecture from SǪL Server to PostgreSǪL.
• Built ELT/ETL pipelines for cloud and on-premises data loading.
• Migrated 500+ ETL jobs from SǪL Server stored procedures and Informatica to Azure Databricks.
• Developed high-volume migration frameworks to Azure using Databricks, ADF, PySpark, Data Lakehouse, and Blob Storage.
• 20 TB Data Migration from SǪL server to Azure SǪL server (DMA)
• Designed CDC pipelines from SǪL on-premises to Azure SǪL Managed Instance.
• Conducted code reviews and implemented best practices.
• Delivered POCs on ChatGPT AI, Open Metadata for Data CatLog, Profiling, Governance, and Lineage.
• Developed scalable ETL/ELT pipelines using Azure Data Factory and Databricks to ingest, cleanse, and transform large volumes of structured and semi-structured data.
• Configured self-hosted integration runtime to enable secure and reliable data migration from on-premises SǪL Server databases to Azure Data Lake.
• Established a folder structure and partitioning strategy in ADLS to optimize storage and query performance.
• Automated data ingestion workflows with monitoring, logging, and error handling, improving data availability
• Collaborated with data scientists and analysts to provide clean, curated datasets, accelerating analytics and reporting.
• Cleanse, standardize, and transform raw data into usable formats.
• Apply partitioning, compression, and schema evolution strategies.
• Tune queries and pipelines for faster performance and lower cost.
• Manage storage tiers (hot, cold, archive) in Azure Data Lake Storage.
• Ensure data meets governance policies (naming standards, PII handling).
• Perform data quality checks, deduplication, and anomaly detection.

Mar 2021 – Dec 2022 · 1 yr 9 mos

• Providing Technical Leadership to data engineering team members in developing, constructing, testing and maintaining first-class cloud data architectures.
• Lead and mentor a team throughout design, development and delivery phases and keep the team intact on high pressure situations.
• Have worked as a software professional specializing in Oracle 12c, Performance Tuning, MySQL, PostgreSQL, MongoDB, Python, Google Cloud , AWS,Airflow,Panda,Pyspark, Hadoop,sqoop,hive,SQL Loader and Unix shell scripting.
• Developed framework for high-volume of Data Migration on-premises (Structured and unstructured data) to Google Cloud Platform using Pyspark and python.
• Hands on Experience deploying data analytics & Data Pipeline solutions in GCP using BigQuery ,Redshift ,datastore, Dataproc , Data Pipeline , Airflow ,Aws ,Redshfit ,S3 Bucket and cloud storage.
• Strong experience in working in Datawarehouse, Data lake, Hadoop Dataproc and Pyspark cluster (GCP).
• Working knowledge on creating CI/CD pipelines using Jenkins and Team foundation server (repository).
• Hands on experience in Change Data Capture (CDC) ,Data Migration, Transformation, PL/SQL Programing, Python for ETL, Unix Shell scripting Google Cloud Agile and Micro service as a platform.
• Create automated unit tests and data validation scripts, Implement system health monitoring and alerts.
• Experience in various ingestion (batch & real time) and curation techniques for structured /unstructured data on distributed environment.
• Hands on experience in using tools like Jenkins,Svn,Git ,Bitbucket,Jira,Tspace & Devops.
• Developed automated data delivery pipelines and services to integrate data from the data lake to internal and external consuming applications and services.

Jun 2018 – Mar 2021 · 2 yrs 9 mos

• Have worked as a software professional specializing in Oracle 12c, Performance Tuning, MySQL, PostgreSQL, MongoDB, Python, Google Cloud , AWS,Airflow,Panda,Pyspark, Hadoop,sqoop,hive,SQL Loader and Unix shell scripting.
• Developed framework for high-volume of Data Migration on-premises (Structured and unstructured data) to Google Cloud Platform using Pyspark and python.
• Developed Google Cloud automation scripts for data export and import from GCP Cloud SQL Prod to Test envierment.
• Developed Google Cloud automation scripts for data export and import from GCP Cloud SQL & BigQuery Prod to Test envierment.
• Hands on Experience deploying data analytics & Data Pipeline solutions in GCP using BigQuery ,Redshift ,datastore, Dataproc , Data Pipeline , Airflow ,Aws ,Redshfit ,S3 Bucket and cloud storage.
• Strong experience in working in Datawarehouse, Data lake, Hadoop Dataproc and Pyspark cluster (GCP).
• Working knowledge on creating CI/CD pipelines using Jenkins and Team foundation server (repository).
• Analyze complex, high-volume, high-dimensionality data from varying sources using a variety of ETL and data analysis techniques.
• Experience in various ingestion (batch & real time) and curation techniques for structured /unstructured data on distributed environment.
• Design, develop, and implement ETL pipelines for Enterprise DWH & Data marts ingesting both structured and unstructured data.
• Strong experience in designing ETL, DWH & Data lake solutions with large datasets using Oracle Databases, & Big-data technologies. Export in Advance SQL query writing and PLSQL logic design in oracle, MYSQL , PostgreSQL & Analytics databases like Amazon Redshift & GCP Big query.
• Hands on experience in using tools like Jenkins,Svn,Git ,Bitbucket,Jira,Tspace & Devops.
• Developed automated data delivery pipelines and services to integrate data from the data lake to internal and external consuming applications and services.

Jun 2016 – Jun 2018 · 2 yrs · Bangalore

•  Responsible for requirement gathering, analysis, design and development of any enhancements in the application.
•  Prepare the Low level design document (LLD) for application related.
•  Involved in preparation of design documents for all the impacted methods and for new functionality.
•  Developed the Oracle Procedure ,Function ,Package, Materialized View , Trigger, and shell script for get CDC (Change Data capture ) Delta.
•  Data Integration Framework Development – {Realtime ,Near Real time and Batch}
•  Managed tables, indexes,constraints,views,sequences,synonyms and stored program units.
•  Designed the overall architecture for Data Migration from Oracle Database to Oracle and Oracle to MongoDB.
•  Used Bulk Collect , Bulk Binds to improve performance by minimizing the number of contest switches between the PL/SQL and SQL engines.
•  Participated in design discussions with the application architects and suggested design changes to improve database performance.
•  Performed Oracle Performance tuning using SQL_TRACE , DBMS_PROFILER and EXPLAIN PLAN.
•  Wrote complex queries and sub queries to do analysis work and generated reports to validate results.
•  Create MongDB collection along with collection schema validation.
•  Write a complexes query fetch delta records for near real time (NRT) .
•  Performance Tuning long running query and taking objects.
•  Developed shell scripts to load the data through sql * loader and responsible to develop alert mechanism for file system
•  Developed automation script for generated generic source code for Trigger and Procedure identified the delta records.
•  Attend daily scrum of scrum calls and address blockers.
• Achievements:
•  Designed Event Generation Framework for real time data processing.
•  Developed automation script for generated generic source code for Trigger and Procedure identified the delta records.
•  Developed automation script for reduce manual work, batch process and resource power.

Jun 2014 – Jun 2016 · 2 yrs · Pune, Maharashtra, India

•  Involved in requirement gathering, analysis and design phase.
•  Enhanced the application by developing and delivering new demands to support business.
•  Attending calls and meetings with Clients and Internal to the organization by providing Technical and Functional subject expertize.
•  Performed Migration activity to support Disha Program.
•  Creating PL/SQL Procedure, Function, Package as per business requirement providing technical solutions and Development for requirements raised by Clients.
•  Developed Unix Shell scripts with embedded SQL*Loader calls and PL/SQL statements to extract data from the legacy application in the form of flat files and load the extracted data into the new application.
•  Worked with product managers to give work estimates and design.
•  Wrote complex SQL script, analytical function.
•  Improved query performance by query’s optimization - tracing the query execution plan (explain plan)
•  Used job scheduling tool like Cron job.
•  Performed SIT, UAT, Production Roll Out, Post Production Sanity, Handover to Production Team and Resolved Production Issues.
•  Developed shell scripts to pull the file from different source through FTP.
• Environment: PL/SQL, Unix Shell Scripting ,Oracle 12c,Oracle 11g,TOAD,Sql Developer ,SQL*Plus, Putty and WinSCP.

Jul 2012 – Jun 2014 · 1 yr 11 mos

•  Involved in requirement gathering, analysis and design phase.
•  Creating PL/SQL Procedure, Function, Package and Trigger as per business requirement providing technical solutions and Development for requirements raised by Clients.
•  Wrote complex SQL script, analytical function.
•  Improved query performance by query optimization - tracing the query execution plan (explain plan)
•  Developed shell scripts to pull the file from different source through FTP.
•  Used job scheduling tool like Cron job.
•  Analyzed the existing database and involved in extensive analysis.
•  Responsible to do unit testing and prepared unit Test case and supporting SIT and UAT.
• Environment: PL/SQL, Unix Shell Scripting ,Oracle 11g,Oracle 10g,TOAD,Sql Developer ,SQL*Plus, Putty and WinSCP.

Dec 2010 – Jul 2012 · 1 yr 7 mos

•  Coded and debugged Stored Procedure, Package and Views in Oracle Databases using SQL and PL/SQL , which were called by user-oriented application modules.
•  Extensive querying using SQL*plus/TOAD to monitor quality & integrity of data.
•  Developed shell scripts to pull the file from different source through FTP.
•  Developed shell scripts to load the data through sql * loader and responsible to develop alert mechanism for file system.
•  Analyzed the existing database and involved in extensive analysis.
•  Developed oracle Reports,PL/SQL packages to perform Certain Specialized functions.
•  Involved in in unit level testing, Module level testing and Integration testing at the primary level before the modules are delivered to the Quality department.
•  Analyzed queries using SQL Trace facility and Explain Plan utility to obtain the execution process. Optimized the queries by modifying the data access methods, Index strategies, Join types and operations and providing hint.
• Environment: PL/SQL, Unix Shell Scripting ,Oracle 11g,Oracle 10g,TOAD,Sql Developer ,SQL*Plus, Putty and WinSCP.