Vishal Jadhav

Data Engineer

Bengaluru, Karnataka, India8 yrs 4 mos experience
Most Likely To SwitchAI ML Practitioner

Key Highlights

  • Led development of high-performance data extraction system.
  • Optimized end-to-end data pipeline orchestration.
  • Expert in modern data engineering practices.
Stackforce AI infers this person is a Data Engineer specializing in SaaS and cloud-based data solutions.

Contact

Skills

Core Skills

Data EngineeringData Warehousing

Other Skills

AWS DMSAWS LambdaAlgorithmsAmazon EC2Amazon ECSAmazon RedshiftAmazon Relational Database Service (RDS)Amazon S3Amazon SQSAmazon Web Services (AWS)Amazon sesAnacondaApache AirflowApache KafkaApache Pig

About

I completed M.tech from VIT University, I have Strong knowledge and experience of Big data, Aws Cloud Data Engineering, Machine learning, Python, libraries numpy, scipy, pandas. Data visualization tools like tableau, Excel. As an accomplished Data Engineer with 6 years of experience, I specialize in designing and implementing sophisticated data systems that drive actionable insights and support data-driven decision-making. My expertise spans a broad array of tools, technologies, and methodologies that are essential for managing and optimizing data workflows in today’s dynamic environment. Core Competencies: Data Warehousing & Analytics: Proficient in leveraging managed data warehouse services like AWS Redshift and Google BigQuery to handle large-scale data analysis and storage needs. Workflow Automation: Skilled in using Apache Airflow for orchestrating complex workflows and managing data pipelines with precision and reliability. Modern Data Engineering Practices: Adept at implementing Data Lakehouse architectures to unify data lakes and data warehouses, supporting real-time analytics, and embracing DataOps for agile data management. Event-Driven and Serverless Architectures: Experienced in designing systems with Event-Driven Architecture and Serverless Data Processing, utilizing platforms like AWS and Google Cloud Pub/Sub to build scalable, efficient data solutions. Programming & Data Management: Expertise in PySpark for distributed data processing and PL/SQL for advanced database management. Proven ability to ensure Data Quality Management and handle Schema Evolution effectively. Emerging Trends & Technologies: Passionate about integrating Artificial Intelligence (AI) and Machine Learning Operations (MLOps) into data workflows, while ensuring compliance with Data Privacy regulations such as GDPR. Achievements & Impact: Led the development of a high-performance data extraction system using serverless architectures and event-driven design, significantly improving processing efficiency and reducing costs. Successfully managed end-to-end data pipeline orchestration, optimizing workflows and data integration to deliver timely insights and support strategic decision-making. I am committed to pushing the boundaries of data engineering by continually exploring new technologies and methodologies. My goal is to leverage my skills to build innovative data solutions that address complex challenges and drive business success.

Experience

8 yrs 4 mos
Total Experience
2 yrs 1 mo
Average Tenure
4 yrs
Current Experience

Walmart global tech india

Data Engineer

Jun 2022Present · 4 yrs · Bengaluru, Karnataka, India · Hybrid

  • Designed, built, and optimized data pipelines for efficient data processing and integration.
  • Performed data migration and integration from various sources into centralized repositories.
  • Built and maintained data models and schemas to support business intelligence and reporting.
  • Ensured data security and compliance with industry standards and regulations, including encryption,
  • access control, and data masking.
  • Developed Extract, Transform, Load (ETL) processes to cleanse, enrich, and transform data for
  • downstream consumption.
  • Automated and monitored data pipelines to ensure reliability, performance, and uptime.
  • Implemented logging and alerting mechanisms to proactively detect and resolve data pipeline issues.
  • Collaborated with the business team to gather, analyze, and document data requirements, ensuring
  • alignment with business goals and translating them into technical specifications.
  • Facilitated requirements-gathering sessions to identify data needs for data processing, reporting
  • solutions, and pipeline optimization, ensuring solutions met business expectations.
Data PipelinesData WarehousingETLData SecurityData IntegrationData Modeling+1

Halodoc technology

Data Engineer II

Sep 2021Jun 2022 · 9 mos · Bengaluru, Karnataka, India · Hybrid

  • Migrating Data from different sources to the Data lake using AWS DMS.
  • Creating the reporting layers
  • Building end to end Data pipeline
AWS DMSData LakeData PipelineData Engineering

Bristleconelabs.ai

Data Engineer

Nov 2019Sep 2021 · 1 yr 10 mos · Bengaluru, Karnataka

  • Building end-to-end Data pipelines.
  • optimizing the existing data pipelines.
  • Production deployments.
Data PipelinesData OptimizationProduction DeploymentsData Engineering

Autodesk

3 roles

DevOps Data Engineer

Mar 2019Nov 2019 · 8 mos

Data Engineer

Promoted

Jul 2018Mar 2019 · 8 mos

Jr. Data Engineer

Feb 2018Jul 2018 · 5 mos

Education

Vellore Institute of Technology

Master of Technology (M.Tech.) — Information Technology

Jan 2015Jan 2017

Amravati University

Bachelor of Engineering (BE) — Computer Engineering

Jan 2009Jan 2013

Stackforce found 100+ more professionals with Data Engineering & Data Warehousing

Explore similar profiles based on matching skills and experience