Varun Manireddy — Data Engineer

Results driven Data Engineer with 3.5 years of hands-on experience in software development, specializing in ETL (Extract, Transform, Load) technologies. My expertise lies in utilizing robust tools and languages such as Python, PySpark, SQL to design and implement efficient ETL processes. I thrive in creating and implementing strong data solutions, focusing on integrity, scalability, and efficiency. My goal is to provide top-notch, data-driven insights for organizations. I also have a B.Tech degree in Electronics and Communication and I am passionate about learning new technologies and creating impactful solutions for complex business problems. •Experience in end-to-end DW implementations. Developed multiple usecase pipelines both in onprem and Cloud (GCP & Azure). • Led many features and enhancements in improvising a custom framework to reduce manual efforts, cost efficient and monthly billing costs, meeting business requirements SLA. •Extensively involved in developing a custom framework using most of the GCP, Azure cloud services integrated with multiple well known api's to secure and maintain code quality standards. •Optimized the monthly billing costs by 50%, implemented parallel ingestion techniques, cluster optimization standards. • CI/CD pipelines have been managed efficiently to meet code coverage, sonar qube issues, secapi scans and GLAPI standards for ensuring data integrity, data quality, coding standards. •Experience in large-scale historical data loading activities including cleansing, transformations, standardization, change data capture, rationalization, and enrichment. •Extensively taken part in data analysis and data validation. •Possess excellent communication, interpersonal skills and leadership qualities. •Tech stack comprises of Python, SQL, Pyspark, GCP, Google Cloud Storage, BigQuery, Dataproc, Cloud Run Functions, Micrsoft Azure, Azure Data Lake, Azure Data Factory, Key Vault, Azure Databricks, Kafka, Terraform, Streamsets, Hadoop, Postman, Linux, Hive, HDFS. I expect myself to turn from a novice to an expert in terms of the knowledge and skills I possess and their application to various problems

Stackforce AI infers this person is a Data Engineer specializing in ETL processes within cloud environments.

Location: Kakinada, Andhra Pradesh, India

Experience: 3 yrs 10 mos