Kamleshwar Chandramouli — DevOps Engineer

𝐆𝐢𝐭𝐇𝐮𝐛 𝐏𝐫𝐨𝐟𝐢𝐥𝐞 ➟ https://github.com/imkamleshwar ◉ Over 7 years of IT experiences in Big Data, Cloud, Data Engineering, Machine Learning (Deep learning) and Mainframe. ◉ Having around 5 years of extensive hands-on experience in Big Data technologies Spark, Scala, Hadoop, PySpark, Python, TensorFlow, Scikit-Learn, Pandas, Hive, HDFS, AWS Services, Airflow & GCS. ◉ Having 2+ years of experience in Cloud technology (AWS & GCP). ◉ Good understanding of model development using TensorFlow. ◉ Good Understanding of Machine Learning techniques, Deep Learning (Neural Networks), CNN, RNN and LSTM. ◉ Extensive experience with design, development, customisation, and implementation of software applications Big Data technologies. ◉ Extensive experience in Spark job optimizations and tuning techniques. ◉ Experienced with processing different file formats like Parquet, ORC, Avro, JSON and Sequence file formats using Spark. ◉ Experience in implementing Spark using Scala and Spark SQL for faster analysing and processing of data. ◉ Experience in designing table partitioning, bucketing and optimized hive scripts using different performance utilities and techniques. ◉ Experience in Agile methodology. ◉ Design and implement the user stories and help team members on technical issues. My competencies are: ➟ Spark ➟ Scala ➟ PySpark ➟ Python ➟ TensorFlow ➟ Pandas ➟ Kafka ➟ HDFS ➟ Akka ➟ Oozie ➟ Hive ➟ AWS EMR ➟ AWS S3 ➟ AWS RDS ➟ Shell Scripting I am always interested in hearing from anyone who tells something interesting about "The Universe" and number 42 (the answer to life, the universe and everything), so feel free to contact me at kamleshwar.001@gmail.com.

Stackforce AI infers this person is a Big Data and Cloud Data Engineering expert with a focus on machine learning.

Location: Bengaluru, Karnataka, India

Experience: 7 yrs 3 mos

Skills

Spark
Scala
Python
Pandas
Data Ingestion

Career Highlights

Over 7 years of experience in Big Data and Cloud technologies.
Expert in optimizing Spark jobs, reducing runtime by up to 60%.
Strong background in machine learning and data engineering.

Work Experience

Cognizant

Senior Associate (1 yr 2 mos)

Scienaptic AI

Data Engineer (3 mos)

IQVIA

Software Engineer 2 (11 mos)

Tavant Technologies

Senior Software Engineer (2 yrs 5 mos)

IBM India Private Limited

Application Developer (2 yrs 7 mos)

Education

Engineer’s Degree at Lovely Professional University

12th at Dayawati Modi Academy, Varanasi

10th at Dayawati Modi Academy, Varanasi

Kamleshwar Chandramouli

DevOps Engineer

Bengaluru, Karnataka, India7 yrs 3 mos experience

Key Highlights

Over 7 years of experience in Big Data and Cloud technologies.
Expert in optimizing Spark jobs, reducing runtime by up to 60%.
Strong background in machine learning and data engineering.

Stackforce AI infers this person is a Big Data and Cloud Data Engineering expert with a focus on machine learning.

Contact

kamleshwar.001@gmail.com LinkedIn

Skills

Core Skills

SparkScalaPythonPandasData Ingestion

Other Skills

AWS EMRAgile MethodologiesAirflowApache KafkaApache PigCCOBOLCassandraConfluenceCore JavaDB2Data CleansingData StandardizationData TransformationDatabases

About

Experience

Cognizant

Senior Associate

Sep 2020 – Nov 2021 · 1 yr 2 mos · Bengaluru, Karnataka, India

Working on modernization of Legacy Ledger system using big data stack.
Designed and implemented generic module for capturing and persisting all error record.
Optimized various spark jobs and reduced the runtime by 50%.
Worked on creation and deployment of various pipelines.
Lead the team of 4 members to fix various bugs.
Developed Apache Spark jobs to ingest data from various Source systems to GCS.
Collaborated with business users/product owners/developers to contribute to the analysis of functional requirements.
Responsible for Data Ingestion, Data Cleansing, Data Standardization and Data Transformation.

SparkScalaHadoopData IngestionData CleansingData Standardization+1

Scienaptic ai

Data Engineer

Mar 2020 – Jun 2020 · 3 mos · Bengaluru, Karnataka, India

Worked on backend of an application to read the excel files using python pandas to apply sheet
formulas of each cell and save the results in Django databases.
Worked on productionization of in-house application using Flask.
Helped the client data scientist team in migrating databases of an application from MS SQL server to
Maria DB and schedule the jobs using Airflow

PythonPandasFlaskAirflow

Iqvia

Software Engineer 2

Apr 2019 – Mar 2020 · 11 mos · Bengaluru Area, India

Build batch and real time data ingestion pipeline using StreamSets.
Created pipeline for ingestion of files from windows file system to HDFS via SFTP.
Created pipelines for reprocessing of failed files and log creation.
Mentored team mates on Big Data stack.

StreamSetsHDFSData Ingestion

Tavant technologies

Senior Software Engineer

Nov 2016 – Apr 2019 · 2 yrs 5 mos · Bengaluru Area, India

Worked on migration of ETL jobs to Hadoop platform using Spark and Scala APIs.
Wrote Unit and Integration test cases for Spark jobs.
Created Shell Scripts to run Spark and Hive applications on AWS EMR cluster.
Developed pipelines which uses AWS RDS to keep track jobs status.
Created AWS S3 event-based job triggers using AWS Lambda.
Tuned Spark jobs which reduced the time of completion to more than 60%.
Experience in designing Oozie workflows to co-ordinate spark, hive and shell actions from Hue UI.
Performed Data enrichments such as Filtering, Grouping, Sorting, Aggregation etc. in Spark
Created and implemented Spark Dataframe transformations to map business analysis and load the data into AWS S3 buckets.
Worked on creating Hive managed and external tables based on the requirement

SparkScalaAWS EMRHive

Ibm india private limited

Application Developer

Jan 2014 – Aug 2016 · 2 yrs 7 mos · Bengaluru Area, India

Handled Major Enhancements, Minor Enhancements and Change Requests using Kanban.
Handled Change Request and execute Unit Testing, SIT and UAT.
Preparation of test cases for doing Unit Testing, SIT and UAT.
Provided on call support for production abends.
Monitored batches jobs and taking backups for datasets and files.
Build and honed the skills in the Big Data.

KanbanUnit TestingSITUAT