Bhargavi Mekala

Data Engineer

Hyderabad, Telangana, India4 yrs 6 mos experience

Key Highlights

  • Expert in designing scalable data pipelines.
  • Proficient in AWS cloud data engineering.
  • Skilled in data orchestration using Airflow.
Stackforce AI infers this person is a Data Engineering expert with strong AWS and data pipeline development skills.

Contact

Skills

Core Skills

Data Pipeline DevelopmentAwsAirflowPalantir FoundryWorkflow Orchestration

Other Skills

Amazon Web Services (AWS)Apache AirflowData EngineeringData PipelinesDatabricksEC2EMRLambdaPalantirPostgreSQLPySparkPysparkPython (Programming Language)RedshiftS3

About

Data Engineer with 4 years of experience designing and developing scalable data pipelines using Python, Spark, and big data technologies. Proficient in SQL, cloud data engineering (AWS), and data orchestration (Airflow). Skilled in: Languages: Python, SQL, Shell Scripting Databases: Postgres, Snowflake Big Data: Hadoop, PySpark, Databricks Cloud: AWS (S3, EC2, EMR, SQS, SNS, Lambda) Orchestration: Airflow Other Technologies: Jenkins, Git, Palantir

Experience

Msd

Specialist Data Engineer

Sep 2025Present · 6 mos · Hyderabad, Telangana, India · Hybrid

Advance auto parts india

Associate Data Engineer

Oct 2023Aug 2025 · 1 yr 10 mos · Hyderabad, Telangana, India · Hybrid

  • Roles and Responsibilities:
  • 1) Tech stack: AWS Airflow, S3, EMR, EC2, Lambda, Snowflake, Databricks, Pyspark, PostgreSQL, Palantir Foundry
  • 2) Data Pipeline Development: Designed and implemented scalable data pipelines to ingest, transform, and load data from multiple sources into Snowflake and S3, handling datasets up to 1 TB.
  • 3) Airflow Orchestration: Developed and maintained Airflow DAGs for automating workflows across various modules, ensuring seamless integration with other tools like Databricks, Talend and EMR.
  • 4) AWS Services Integration: Worked extensively with AWS services (S3, EMR, EC2, Lambda, SNS, Airflow) to support data orchestration, storage, and processing.
  • 5) Palantir Foundry Integration: Worked in integrating Palantir Foundry for visualization and user-driven decision-making, enabling insights into sales, forecasts, and adjustments.
  • 6) Issue Resolution: Troubleshot and resolved connectivity issues between Airflow and other components, ensuring system reliability and performance.
  • 7) Collaboration: Coordinated with cross-functional teams, including data scientists and business analysts, to ensure data readiness for model training and scoring.
AWSAirflowS3EMREC2Lambda+6

Systech solutions, inc

Associate Data Engineer

Jul 2021Sep 2023 · 2 yrs 2 mos · Chennai, Tamil Nadu, India · On-site

  • Roles and Responsibilities:
  • 1) Tech Stack: AWS S3, Redshift, Lambda, Apache Airflow, Databricks, Pyspark
  • 2) Data Analysis and Optimization: Analyzed the data and created generic logics to reduce redundancy in data. Translated business propositions into quantitative queries to collect and clean the necessary data.
  • 3) Data Pipeline Development: Successfully established a continuous data load mechanism using Snowpipe, ensuring real-time data ingestion and reducing latency for timely insights. Created various tasks based on business requirements for the ETL load. Developed purposeful views based on business needs.
  • 4) Workflow Orchestration: Proficiently managed DAGs, both new and existing, leveraging Apache Airflow to optimize workflow orchestration. Created PySpark functions aligned with business requirements, increasing ETL efficiency and data processing.
  • 5) Documentation and Testing: Documented test cases, execution procedures, data dependencies, and expected results required to satisfy test design scenarios.
AWSS3RedshiftLambdaApache AirflowDatabricks+3

Education

JNTUA College of Engineering, Kalikiri

Jan 2017Jan 2021

Stackforce found 100+ more professionals with Data Pipeline Development & Aws

Explore similar profiles based on matching skills and experience