A

Adhithya Kumar

Data Engineer

Bengaluru, Karnataka, India10 yrs 7 mos experience
Highly Stable

Key Highlights

  • 8 years of experience in Data Engineering and Data Science.
  • Expert in building data pipelines using AWS and GCP.
  • Strong background in Big Data technologies and cloud platforms.
Stackforce AI infers this person is a Data Engineering expert with extensive experience in cloud computing and big data solutions.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBig Data EngineeringSystems Engineering

Other Skills

AWS CloudFormationAWS EC2AWS EMRAWS GlueAWS LambdaAWS S3AWS Step FunctionsAmazon CloudTrailAmazon CloudWatchAmazon Elastic MapReduce (EMR)Amazon Web Services (AWS)Analytical SkillsApache FlumeApache KafkaApache Pig

About

A passionate Data Engineer with 8 years of work experience in handling Data Ops and Data orchestration pipelines, currently seeking for opportunities in Data Engineering and Data Science domain, to utilize my technical skills and potentiality. Worked on Data pipelines using tools in Hortonworks and Cloud Platform, currently working on projects related to Machine learning and Data Science domain. Programming Languages : Scala, Python, SQL, Linux Shell scripting. - Big Data : Hadoop, HDFS, YARN, Mapreduce, SQOOP, Hive, Kafka, Spark, Elasticsearch, Hortonworks Distribution. - AWS Cloud Stack : AWS EC2 (Elastic Cloud Compute), S3 (Storage), EMR (Elastic MapReduce), AWS Redshift, AWS Glue, AWS Lambda, AWS Cloudwatch, AWS Cloudtrail, AWS Aurora, AWS Stepfunctions, AWS Cloudformation, AWS DynamoDB - GCP Cloud Stack: GCS (Google Cloud Storage), Cloud Dataproc, Cloud Dataflow, BigQuery, Cloud Run. - Visualization tools : Qliksense, Matplotlib, AWS Quicksight - Build tool : Scala SBT, Maven - DevOps tool: Jenkins CICD, Docker, Kubernetes, Terraform - Databases : MySQL, PostgreSQL - Version Control : Git, GitLab, Bitbucket - Integrated Development Environment (IDE) : Eclipse, IntelliJ, PyCharm, Anaconda (for Python), VS Code Apart from technical skills, I have exposure towards process-oriented skills such as Agile Scrum and Lean process. I have exposure in the German language and have handled technical documentation in German for German clients.

Experience

Fractal

Senior Data Engineer

Jan 2024Present · 2 yrs 2 mos · Greater Bengaluru Area

Tiger analytics

Data Engineer

Nov 2020Dec 2023 · 3 yrs 1 mo · Chennai, Tamil Nadu, India

  • Developed a serverless datalake and ETL flow for critical business applications using AWS services such as Lambda, Glue, Cloudformation, Stepfunctions, DynamoDB, etc.
  • Created a GCP data accelerator ingestion framework to ingest data into GCP services using tools such as Dataflow, Dataproc, GCP Composer and DataFusion.
  • Created a batch data pipeline for scheduled batch load for a manufacturing client data, from Qliksense batch workflow to AWS batch using AWS EMR, S3, EC2, etc.
AWS LambdaAWS GlueAWS CloudFormationAWS Step FunctionsDynamoDBGCP Dataflow+7

Renault nissan mitsubishi alliance, india

Data Engineer

Oct 2019Oct 2020 · 1 yr · Chennai Area, India

  • Development and support for a search based application using Apache Spark and Elasticsearch, Querying the index data using Kibana.
  • Design of data pipeline and a data warehousing system from different sources using Apache Spark.
  • Developing applications in AWS for data handling, distributed data storage, and Manipulation using AWS EMR, S3 and Athena.
  • Migration of HDFS data lake applications into Google Cloud Platform using GCP services such as BigQuery, GCS, Dataproc.
Apache SparkElasticsearchAWS EMRAWS S3GCP BigQueryGCP Dataproc+2

Tata consultancy services

2 roles

Systems Engineer

Promoted

Jun 2017Oct 2019 · 2 yrs 4 mos · Chennai Area, India

  • Started working in Big Data technology and using tools such as Hadoop and Hive.
  • Developed a data pipeline to retrieve the data from the Hive system to downstream systems for ETL using HiveQL.
  • Migrated HiveQL jobs to Spark process using Pyspark.
  • Working on Spark Structured streaming to retrieve the data from multiple feeds as a live stream and provide the streamed data to the downstream systems. Developed the module using Scala.
  • Undertaken many Development projects related to Big data and analytics.
  • Worked on many POCs and proposed them to the organization for future projects.
  • I have also trained new associates in the team at technical level and application level.
HadoopHiveSparkPysparkBig Data Engineering

Assistant System Engineer

Jun 2015Jun 2017 · 2 yrs · Chennai Area, India

  • Handling Linux Batch process and other issues in the production stream under Banking and Finance domain.
  • Handling regular incidents and service requests, Disaster recovery testing (DR testing), permanent fixes for regular issues in the production stream.
  • Developed reporting modules using Linux Shell Scripting and scheduled jobs in Crontab.
Linux Shell ScriptingCrontabSystems Engineering

Education

Liverpool John Moores University

Master of Science - MS — Artificial Intelligence and Machine Learning

Jan 2019Jan 2021

International Institute of Information Technology Bangalore

Post Graduate Diploma in Machine Learning and Artificial Intelligence from IIIT Bangalore

Jan 2019Jan 2020

Anna University Chennai

Engineer’s Degree — Electrical and Electronics Engineering

Jan 2011Jan 2015

Vidyaa Vikas Matric Hr. Sec School, Karamadai, Coimbatore

11th and 12th

Jan 2009Jan 2011

Nyruthi Matric School

10th

Jan 2005Jan 2009

TEA Public Matriculation Hr Sec School

Jan 1999Jan 2005

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience