Muniraj G

Product Engineer

Bengaluru, Karnataka, India11 yrs 10 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Stackforce AI infers this person is a Data Engineering professional with expertise in cloud data solutions and performance optimization.

Data EngineeringApache SparkData Analysis

Agile MethodologyAzure Data FactoryAzure DatabricksBigQueryHadoopHiveInformaticaKafkaMicrosoft SQL ServerPySparkPython (Programming Language)SQLSqoop

Nov 2021 – Present · 4 yrs 4 mos · Bengaluru, Karnataka, India · Remote

● Build the data pipeline that Ingest the data to Azure Datalake/HDFS from Multiple data sources
● Led the Migration of data from Multiple sources to ADLS GEN2 thereby empowering team to Analyze
● Led the Migration to cloud that resulted in a cost saving of 37%
● Led the Performance Initiatives that optimized the queries to yield a 70% Improvement in data processing speed
● Rater then analysing the data in database, Moved the data to datalake
and Analyze it
● Wrote the Bunch of transformations in Existing tables and new requirements
● Implemented the Model customer 360 view for ETB’s and NTB’s based on transactions
● Used serverless Synapse for one of the daily Jobs and Optimized it to scan less data by using columnar file format and other techniques
● Migrating the project from Pyspark to Databricks

Azure Data FactoryAzure DatabricksApache SparkData EngineeringPython (Programming Language)Hadoop+2

Oct 2018 – May 2021 · 2 yrs 7 mos · Chennai, Tamil Nadu, India · Hybrid

● Ingested the data from Multiple sources to Informatica data
warehouse
● Performed the Bunch of transformations as per the Business requirements
● I was involved one project from Hive to Pyspark
● Collaborated with multiple teams to expedite data extraction with SQL, reducing report generation time by 16 minutes
● Ensured the workflow not to get failed and database tables not to get affected (Created the Framework)
● Increased the data extraction speed changing the settings in Workflow
● Coordinated with other teams and share the report as per their requirement use cases

InformaticaHivePySparkSQLData Engineering

Aug 2015 – Oct 2018 · 3 yrs 2 mos · Chennai, Tamil Nadu, India · Remote

● Cleaned 1.3 GB of raw data, improving overall data accuracy
● Analyzed data in BigQuery, reporting 2 operational bottlenecks
● Review & Preparation of test scenarios for Business use cases
● Involved with Multiple stakeholders to get the requirements as per the users Input and coordinated with the developers to create the view accordingly
● Performing the Root Cause Analysis for all the defects raised
● Once the development is completed reviewing the dashboard with PPO’s
● Analyzing the loaded data if complies with the requirements
● Reviewing leads with the users to accept the deal
● Validated the performance efficiency in all the dashboard and increased
● Conducted in-depth data analysis to support to business strategy
Development, contributing to a 15% increase in Operational efficiency
● Participated in team project to enhance the data quality, achieved 20%
Improvement in Data accuracy
● Implemented the different model based on mode of transactions for users view and from that Revenue benefits to the company
● Followed the Agile Methodology for deliverables
● Cleaned the data to 30% in one of the Existing project after the data analyse
● Preparing all the versions of Mapping documents and use cases for the projects

BigQueryData AnalysisAgile Methodology

Nov 2013 – Aug 2015 · 1 yr 9 mos · Chennai, Tamil Nadu, India · On-site

Inserting the new data into the SQL databases
Monitoring the frequency run and incase of any failures, Raising the ITSM Ticket to
support team to resolve
Exporting the tables from hive to Microsoft Sql server for Business Requirements
Imported all the CRM tables to hive in one of the project for leads process to
increase the performance 35%
Supported to other teams if any issues in data correctness
Move tables from Existing server to new server to based on regions
Supported for production related issue and tasks

SQLHive