Kokila M

Data Engineer

Tamil Nadu, India11 yrs 11 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in migrating data to cloud platforms.
Proficient in big data technologies and analytics.
Strong background in data engineering and optimization.

Stackforce AI infers this person is a Big Data Engineer with expertise in Fintech and cloud data solutions.

Contact

Skills

Core Skills

Google Cloud Platform (gcp)Big DataApache SparkPython (programming Language)HadoopEtl

Other Skills

Hive SQLDataProcHiveApache PigSQLNoSQLApache SqoopPySparkApache KafkaExtract, Transform, Load (ETL)HiveQLTeradata

About

Experienced Big Data Developer with a demonstrated history of working in the automotive, financial and banking industry . Skilled in Hadoop, spark, pyspark, Hive, HBase, python, shell scripting, mysql, Data Engineering, and Hadoop. Strong engineering professional with a Bachelor of Engineering - BE focused in Electrical, Electronic and Communications Engineering Technology/Technician from Anna University.

Experience

Paypal

Data Engineer 3

Dec 2021 – Present · 4 yrs 3 mos · Chennai, Tamil Nadu, India · On-site

¨ Migrating existing On-Prem jobs to GCP BigQuery and GCS, resulting in a XX MM savings and significant resuction in processing time.
¨ Coordinated with Data Science and Business Intelligence teams to implement advanced analytics models across extensive datasets in BQ and DataProc.
¨ Collaborated within the team to optimize costs and improve query performance within BigQuery.
¨ Automated Quality Assurance (QA) reporting for all available reports, mitigating potential data errors and ensuring accuracy.
¨ Utilized Google Data Catalog for efficient monitoring, query optimization, and comprehensive billing analysis for BigQuery usage.
¨ Developed Hive SQL scripts for the creation of intricate tables, incorporating high-performance metrics like partitioning, clustering, and skewing.
¨ Created BigQuery authorized Materialized Views to enforce row-level security measures and facilitate data accessibility for other teams.
¨ Proficiently managed the migration of DataProc jobs to BigQuery, ensuring seamless transition and functionality.

Google Cloud Platform (GCP)Big Data

Deloitte touche tohmatsu llc

Consultant

Jun 2020 – Dec 2021 · 1 yr 6 mos · Chennai, Tamil Nadu, India · On-site

¨ Led end-to-end data processing operations involving ingestion, processing, and rigorous quality checks within FDPS, a pivotal data repository housing PayPal credit and debit transaction details.
¨ Demonstrated proficiency in developing PySpark applications, leveraging its capabilities for efficient data processing and analysis.
¨ Crafted Spark SQL statements to streamline and process extensive volumes of data, enhancing performance and accuracy in data manipulation.
¨ Actively involved in the optimization of existing Hive queries, enhancing query efficiency and overall system performance.
¨ Played a key role in the migration of HANA reports to the Hadoop ecosystem, ensuring seamless data transition and operational continuity.
¨ Devised and implemented shell scripts to automate report generation, facilitating the timely delivery of crucial reports to clients.

Apache SparkPython (Programming Language)

Renault nissan technology & business centre india

Senior Software Engineer

Feb 2019 – Jun 2020 · 1 yr 4 mos · Chennai, Tamil Nadu · On-site

¨ Proficiently extracted data from Hive and HBASE to cater to the specific research and development needs of the team.
¨ Leveraged Pig to retrieve data from HBase tables for validation, particularly focused on non-linkage data verification.
¨ Actively engaged in performance optimization of Pig queries, enhancing query efficiency and overall system performance.
¨ Conducted comprehensive design and code reviews, adeptly addressing bugs and swiftly resolving production issues to maintain system integrity.

Apache PigHadoop

Wavicle data solutions

Big Data Developer

May 2018 – Dec 2018 · 7 mos · Coimbatore, Tamil Nadu · On-site

¨ Good experience with ETL tools – Datastage to transform the data coming from different source.
¨ Scheduling jobs and workflows using Automic UC4 for the feed generation.
¨ Shell script to invoke Datastage jobs which process the inbound and outbound feeds.

Apache PigHiveETL

Cognizant

2 roles

Technical Lead

Promoted

May 2016 – May 2018 · 2 yrs · On-site

¨ Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa and Creating Hive tables and working on them using Hive QL
¨ Involved in loading data from UNIX file system to HDFS.

HadoopHive