Rupesh Gottipalli — Data Engineer
Experienced Software Engineer specialized in transforming complex data ecosystems into strategic assets. My expertise in Python, Azure Data Factory, Databricks, and Delta Lake enables me to design and implement scalable, high-performance data pipelines that drive business success. In addition to my data engineering prowess, I have cultivated strong skills in machine learning and natural language processing (NLP). I have hands-on experience with Generative AI, having developed intelligent query generation systems using models like Open AI ChatGPT. This blend of data engineering and AI expertise enables me to deliver innovative solutions that harness the full potential of data. Key Highlights: Azure Ecosystem: Skilled in orchestrating complex data workflows with Azure Data Factory, ensuring data quality and compliance, and leveraging Azure Databricks for large-scale data processing. Big Data Technologies: In-depth knowledge of Delta Lake, Spark, and Kafka, with a focus on improving data reliability and consistency. Data Engineering: Expert in building and optimizing ETL pipelines, data lakes, and real-time data processing systems using Azure and Snowflake. Machine Learning & NLP: Proficient in training and deploying machine learning models, handling imbalanced datasets, and implementing NLP solutions. API Development: Experienced in developing high-performance APIs using FastAPI, and integrating them with event-driven architectures using Azure Event Hubs. DevOps & CI/CD: Adept at implementing CI/CD pipelines for data engineering projects, utilizing tools like Azure DevOps, GitHub Actions, and Jenkins. I am passionate about staying at the forefront of technology advancements and continuously enhancing my skill set. I actively participate in industry forums, attend conferences, and pursue certifications to keep abreast of the latest trends in data engineering and AI.
Stackforce AI infers this person is a Data Engineering and AI specialist in the Healthcare and Media industries.
Location: Hyderabad, Telangana, India
Experience: 12 yrs 10 mos
Skills
- Data Engineering
- Azure Data Factory
- Machine Learning
Career Highlights
- Expert in building scalable data pipelines.
- Strong background in machine learning and NLP.
- Proficient in Azure Data ecosystem technologies.
Work Experience
Warner Bros. Discovery
Staff Data Engineer - HBO Max (1 yr 7 mos)
Providence India
Lead Software Engineer (Azure Data Engineering) (1 yr 11 mos)
Techwave
Senior Software Engineer (Data, Analytics, BI - Azure) (1 yr 9 mos)
SumTotal Systems, LLC
Senior Software Engineer (2 yrs 10 mos)
SDE-II (Software Design Engineer-II) (2 yrs 8 mos)
Indian Institute of Technology, Bombay
Student (2 yrs 1 mo)
Teaching Assistant(T.A) (2 yrs 1 mo)
Education
Master of Technology (M.Tech.) at Indian Institute of Technology, Bombay