SAI MOHAN B

Data Engineer

Bengaluru, Karnataka, India6 yrs 4 mos experience

Key Highlights

  • Expert in optimizing scalable data pipelines.
  • Proven track record in cloud data solutions.
  • Strong background in big data technologies.
Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and big data processing.

Contact

Skills

Core Skills

Data EngineeringEtl OptimizationCloud SolutionsSoftware Development

Other Skills

AWSAWS AthenaAWS CloudFormationAWS ECSAWS EMRAWS GlueAWS Step FunctionsAdobe SparkAmazon EC2Amazon ECSAmazon Elastic MapReduce (EMR)Amazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)Apache Airflow

About

With over 6.2 years of experience Software Field and 4+ in data engineering, I specialize in designing and optimizing scalable data pipelines, automating workflows, and enabling businesses to leverage their data effectively. My expertise spans Python, SQL, PySpark, Apache Airflow, AWS (EMR, Redshift, Athena, S3), and Azure (Data Factory, Databricks, Blob Storage). I have successfully migrated complex queries, optimized ETL processes, and developed robust automation scripts to enhance data processing efficiency. My hands-on experience with big data technologies and cloud platforms allows me to architect and implement high-performance data solutions. 🔹 What I Do Best: ✔️ Big Data Processing: Transforming 100GB+ datasets with PySpark & AWS Glue ✔️ ETL & Data Pipeline Optimization: Designing automated, cost-effective workflows ✔️ Cloud Data Solutions: Deploying & managing infrastructure on AWS & Azure ✔️ Automation & Orchestration: Building reliable workflows with Apache Airflow ✔️ Data Warehousing & Analytics: Structuring data in AWS Redshift, Athena, QuickSight 🔹 My Passion & Mission I thrive on solving complex data challenges and turning raw data into meaningful insights. I am passionate about continuous learning, automation, and leveraging cloud technologies to make data-driven decision-making seamless and efficient. 🚀 Open to connecting with fellow data enthusiasts, recruiters, and professionals looking for scalable and innovative data solutions!

Experience

6 yrs 4 mos
Total Experience
1 yr 3 mos
Average Tenure
1 yr 3 mos
Current Experience

Bahwan cybertek

Data Engineer

Mar 2025Present · 1 yr 3 mos · Bengaluru, Karnataka, India · On-site

Trigent software inc

Data engineering ETL

Oct 2024Jan 2025 · 3 mos · Bengaluru, Karnataka, India · On-site

  • Optimized complex queries by migrating from Redshift to AWS Athena, reducing query costs by 30%.
  • Developed a PySpark-based ETL pipeline on AWS EMR, ingesting terabytes of user interaction data daily.
  • Implemented CDC using Delta Lake (MERGE INTO) in AWS Glue to handle late-arriving events and
  • Eliminate duplicate records.
  • Optimized storage and query performance by transitioning from Parquet to Delta Lake on Amazon S3,
  • Improving Athena query.
  • Automated pipeline orchestration using AWS Step Functions, ensuring seamless integration between EMR, S3, and Glue.
AWS AthenaRedshiftPySparkAWS EMRDelta LakeAWS Glue+3

Guidewire software

Data Platform Engineer

May 2023Feb 2024 · 9 mos · Chennai, Tamil Nadu, India · On-site

  • Aligned technical solutions with business requirements by collaborating with cross-functional teams, resulting in a 20%
  • increase in project delivery speed.
  • Developed efficient Apache Spark code for AWS Glue jobs, optimizing data processing workflows and reducing processing
  • time by 30%.
  • Utilized Python to develop scalable data solutions, increasing data processing efficiency by 25%.
  • Authored SQL queries to streamline data retrieval, reducing query execution time by 20%.
  • Developed robust APIs using FastAPI's asynchronous capabilities, improving web service performance by 35%.
  • Orchestrated and maintained dynamic DAGs within Apache Airflow, reducing data processing delays by 40%.
  • Deployed applications using Docker and AWS ECS, resulting in a 50% reduction in deployment time.
  • Implemented CI/CD pipelines using BitBucket Pipelines, reducing deployment errors by 30%.
  • Deployed applications on AWS cloud services, enhancing deployment efficiency and reducing costs by 15%.
Apache SparkAWS GluePythonSQLFastAPIDocker+4

Guvi geek networks, iitm research park

Software Engineer

Jan 2021Nov 2022 · 1 yr 10 mos · Chennai, Tamil Nadu, India · Remote

  • Developed APIs and orchestrated data workflows with Apache Airflow.
  • Deployed applications on cloud services, focusing on AWS
  • Applied security best practices and database technologies for cloud foundations.
  • Experienced in Handling the Windows server’s as well as the hosting the web applications using IIS.
  • Involved in handling the SSL certification’s using win acme as well as the let’s encrypt in Ubuntu.
  • Deployed Node.js application to production servers using Nginx as a web server
Apache AirflowAWSNode.jsNginxData EngineeringCloud Solutions

Ethnus

Software Engineer -Trainer

Oct 2018Jan 2021 · 2 yrs 3 mos · Bangalore · On-site

  • Trained and managed team of developers and discussed issues in order to provide resolution and apply best practices.
  • Participated in continuous improvement by generating suggestions, engaging in problem-solving activities to support teamwork.
  • Developed and implemented performance improvement strategies and plans to promote continuous improvement.
  • Well Managed company products such as aptimithra.com,learn.codemithra.com .These products in which I worked as full-fledged management has been done so far
  • Involved in Training of AWS sessions, moreover also started preparing for the AWS certifications.
  • Deployed Node.js application to production servers using Nginx as a web server.
  • Deployed applications on cloud services, focusing on AWS
AWSNode.jsNginxSoftware Development

Education

Jawaharlal Nehru National College of Engineering

Bachelor's degree — B.E

Jan 2014Jan 2018

DVS composite Pre-university college,Oxford english high school

High school — Computer Science

Jan 2000Jan 2016

Stackforce found 100+ more professionals with Data Engineering & Etl Optimization

Explore similar profiles based on matching skills and experience