Rupesh Gottipalli

Data Engineer

Hyderabad, Telangana, India12 yrs 10 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Expert in building scalable data pipelines.
  • Strong background in machine learning and NLP.
  • Proficient in Azure Data ecosystem technologies.
Stackforce AI infers this person is a Data Engineering and AI specialist in the Healthcare and Media industries.

Contact

Skills

Core Skills

Data EngineeringAzure Data FactoryMachine Learning

Other Skills

ExperimentationContent MetadataAzure DatabricksPythonPySparkGenerative AIOpenAIAI & MLSQLTerraformPredictive ModelingPandas (Software)Azure Kubernetes Service (AKS)Docker ProductsContinuous Integration and Continuous Delivery (CI/CD)

About

Experienced Software Engineer specialized in transforming complex data ecosystems into strategic assets. My expertise in Python, Azure Data Factory, Databricks, and Delta Lake enables me to design and implement scalable, high-performance data pipelines that drive business success. In addition to my data engineering prowess, I have cultivated strong skills in machine learning and natural language processing (NLP). I have hands-on experience with Generative AI, having developed intelligent query generation systems using models like Open AI ChatGPT. This blend of data engineering and AI expertise enables me to deliver innovative solutions that harness the full potential of data. Key Highlights: Azure Ecosystem: Skilled in orchestrating complex data workflows with Azure Data Factory, ensuring data quality and compliance, and leveraging Azure Databricks for large-scale data processing. Big Data Technologies: In-depth knowledge of Delta Lake, Spark, and Kafka, with a focus on improving data reliability and consistency. Data Engineering: Expert in building and optimizing ETL pipelines, data lakes, and real-time data processing systems using Azure and Snowflake. Machine Learning & NLP: Proficient in training and deploying machine learning models, handling imbalanced datasets, and implementing NLP solutions. API Development: Experienced in developing high-performance APIs using FastAPI, and integrating them with event-driven architectures using Azure Event Hubs. DevOps & CI/CD: Adept at implementing CI/CD pipelines for data engineering projects, utilizing tools like Azure DevOps, GitHub Actions, and Jenkins. I am passionate about staying at the forefront of technology advancements and continuously enhancing my skill set. I actively participate in industry forums, attend conferences, and pursue certifications to keep abreast of the latest trends in data engineering and AI.

Experience

12 yrs 10 mos
Total Experience
2 yrs 9 mos
Average Tenure
1 yr 7 mos
Current Experience

Warner bros. discovery

Staff Data Engineer - HBO Max

Nov 2024Present · 1 yr 7 mos · Hyderabad, Telangana, India · On-site

  • Data engineering for Product engagement, Experimentation and Content metadata for HBO Max and Discovery+ apps globally which are part of Warner Bros. Discovery (https://www.wbd.com/)
Azure Data FactoryData EngineeringExperimentationContent Metadata

Providence india

Lead Software Engineer (Azure Data Engineering)

Dec 2022Nov 2024 · 1 yr 11 mos · Hyderabad, Telangana, India · On-site

  • Transforming Healthcare using Azure Data stack - Azure Data Factory, Azure Databricks, Azure DataLake and also Snowflake. Technologies - Python, PySpark, GenAI, OpenAI, ML.
  • #HealthForABetterWorld #MakingHealthCareBetter
Azure Data FactoryAzure DatabricksPythonPySparkGenerative AIOpenAI+2

Techwave

Senior Software Engineer (Data, Analytics, BI - Azure)

Feb 2021Nov 2022 · 1 yr 9 mos · Hyderabad, Telangana, India

Azure Data FactoryAzure DatabricksData Engineering

Sumtotal systems, llc

2 roles

Senior Software Engineer

Promoted

Apr 2018Feb 2021 · 2 yrs 10 mos · Hyderabad Area, India

Azure Data FactoryPythonData Engineering

SDE-II (Software Design Engineer-II)

Jul 2015Mar 2018 · 2 yrs 8 mos · Hyderabad Area, India

Indian institute of technology, bombay

2 roles

Student

May 2013Jun 2015 · 2 yrs 1 mo · Mumbai Area, India

Teaching Assistant(T.A)

May 2013Jun 2015 · 2 yrs 1 mo · Mumbai Area, India

Education

Indian Institute of Technology, Bombay

Master of Technology (M.Tech.)

Jan 2013Jan 2015

Stackforce found 100+ more professionals with Data Engineering & Azure Data Factory

Explore similar profiles based on matching skills and experience