Kedar Shiral

Data Engineer

Pune, Maharashtra, India4 yrs 6 mos experience

Key Highlights

  • Expert in architecting scalable Big Data solutions.
  • Proficient in optimizing complex SQL queries.
  • Skilled in building robust ETL pipelines.
Stackforce AI infers this person is a Data Engineer specializing in Big Data and Cloud Technologies.

Contact

Skills

Core Skills

Big DataData EngineeringData Warehousing

Other Skills

AWS CloudFormationAWS EMRAWS GlueAWS LambdaAWS Step FunctionsAirflowAmazon DynamoDBAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)Analytical SkillsApache AirflowApache Kafka

About

As a dynamic Data Engineer, I excel in harnessing cutting-edge technologies to transform raw data into actionable insights. My expertise spans Big Data, SQL, Data Warehousing, AWS, Azure Databricks, Kafka, Apache Airflow, Hive, Snowflake, and Python scripting. Key Expertise: ๐Ÿš€ Big Data Solutions: Expert in architecting and implementing scalable Big Data solutions for optimal performance and data-driven decision-making. ๐Ÿ” SQL Mastery: Proficient in crafting intricate SQL queries and optimizing database performance for structured and unstructured data analysis. ๐Ÿ—๏ธ Data Warehousing: Experienced in designing and implementing data warehousing solutions for efficient storage, retrieval, and analysis. โ˜๏ธ Cloud Technologies: Skilled in deploying and managing data infrastructure on AWS and Azure Databricks. ๐Ÿ”„ Data Integration: Expert in building robust ETL pipelines with Kafka and Apache Airflow for seamless data flow and integration. ๐Ÿ Python Scripting: Strong scripting capabilities in Python for efficient data processing and automation. ๐Ÿ“Š Data Analytics: Familiar with tools like Hive for creating analytical solutions and actionable insights. Philosophy: I am dedicated to tackling complex challenges, contributing to the evolving landscape of data engineering, and fostering a data-centric culture. Let's Connect: Passionate about connecting with professionals who share an interest in data-driven decision-making and cutting-edge technologies. Open to collaborations and eager to contribute to the vibrant data community.

Experience

4 yrs 6 mos
Total Experience
1 yr 7 mos
Average Tenure
1 yr 4 mos
Current Experience

Yash technologies

Data Engineer

Feb 2025 โ€“ Present ยท 1 yr 4 mos ยท Pune, Maharashtra, India ยท Hybrid

Zs

Data Engineer

Mar 2024 โ€“ Feb 2025 ยท 11 mos ยท Pune, Maharashtra, India ยท On-site

  • I've played a pivotal role as an Data Engineer at ZS, where I spearheaded the design, development, and optimization of data pipelines utilizing AWS EMR for distributed data processing, S3 for scalable storage and Redshift for high-performance data warehousing. My expertise extends to orchestrating complex workflows with Apache Airflow, ensuring data consistency, reliability, and scalability.
  • Additionally, I am an integral part of the ๐—ญ๐—”๐—œ๐——๐—ฌ๐—ก ๐˜€๐˜๐˜‚๐—ฑ๐˜† ๐—ฝ๐—น๐—ฎ๐—ป๐—ป๐—ถ๐—ป๐—ด ๐˜๐—ฒ๐—ฎ๐—บ, contributing to the strategic direction and implementation of data-driven insights into our study planning processes
Web ScrapingAWS LambdaAirflowAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon S3+12

Zimetrics technologies

4 roles

Software Engineer II

Promoted

Dec 2022 โ€“ Mar 2024 ยท 1 yr 3 mos

  • Build a generic and optimized pipeline for highly critical and confidential diabetes patient data - Pipeline is designed in a way to handle thousands of rows with approximately 2 GB daily incremental data for different use cases like analytics, medical consultation program
  • I was a part of the development team and worked closely with the BI team to understand the requirements and mapping of source data for better OLTP and data warehouse design.
  • Helped with cost-cutting up to 40% by reducing processing time using proper node configuration and suitable partition keys
SnowflakePostgreSQLAmazon Relational Database Service (RDS)Analytical SkillsMapReduceData Warehousing+20

Software Engineer I

Dec 2021 โ€“ Dec 2022 ยท 1 yr

  • Crafted generic AWS solution for S3 datalake to Redshift ingestion on ~4TB+ data.
  • If helped to move Ingestion pipelines from third-party tool Snowflake and saved cost for heavy license fees
  • This generic framework helped other business units for smooth ingestion of newly onboarded Snowflake objects into Redshift datalake.
PySparkAmazon RedshiftPython (Programming Language)Extract, Transform, Load (ETL)MySQLData Engineering+1

Software Engineering Trainee

Sep 2021 โ€“ Dec 2021 ยท 3 mos

Amazon Web Services (AWS)

Software Engineering Trainee

Sep 2021 โ€“ Dec 2021 ยท 3 mos

AWS LambdaBash scripting

Dell technologies

Digital Marketing Intern

Apr 2020 โ€“ Jun 2020 ยท 2 mos

Zensar technologies

Trainee

Dec 2019 โ€“ Jan 2020 ยท 1 mo ยท Pune, Maharashtra, India

Education

D. Y. Patil Pratishthans D.Y. Patil College of Engineering ,Pune

Bachelor of Engineering - BE

Jan 2017 โ€“ Jan 2021

Dayanand Science College, Latur

HSC โ€” General Science

Jun 2015 โ€“ Mar 2017

Shripatrao Bhosale Secondary and Higher Secondary School, Osmanabad

SSC โ€” Semi English

Jun 2009 โ€“ Jun 2015

Nutan Primary School, Osmanabad

Jan 2007 โ€“ Jan 2009

Dr. Babasaheb Ambedkar Primary School, Padoli (A)

Jan 2005 โ€“ Jan 2007

Stackforce found 100+ more professionals with Big Data & Data Engineering

Explore similar profiles based on matching skills and experience