Vaibhav Agrawal

Data Engineer

Pune, Maharashtra, India9 yrs 10 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in Data Warehouse Architecture and Big Data solutions.
  • Proven track record in performance tuning and cost optimization.
  • Strong leadership experience managing teams and projects.
Stackforce AI infers this person is a Data Engineering expert with a focus on SaaS and Big Data solutions.

Contact

Skills

Core Skills

Data WarehousingBig DataData AnalysisData Engineering

Other Skills

AJAXAWS S3AirflowAlgorithmsAmazon QuickSightAmazon S3Apache KafkaBig Data AnalyticsCC++Dashboard DesignData AnalyticsData Flow StructureData MonitoringData Structures

About

Determined,Focused,Self motivated,Result oriented person.

Experience

9 yrs 10 mos
Total Experience
3 yrs 3 mos
Average Tenure
3 yrs 9 mos
Current Experience

Indihood

Data Engineer

Aug 2022Present · 3 yrs 9 mos · Pune, Maharashtra, India · Hybrid

  • Design, re-structure and develop data models of the company. Further implementing analytical databases for optimal analytical querying.
  • Automating the DDL process for any new analytical view requirements.
  • Implementation of Incremental ETL approach for the Data Pipeline to create Quasi-real time experience in DataWarehouse.
  • Automated handling of PII data for the end-view within and outside the organization.
  • Closely worked with the Cost Optimization team to reduce overall cloud cost to a significant fraction.
  • Constantly involved in performance tuning, optimizations, reiterations, feature development for new use cases, scalability and efficient database handling.
  • Used BigTable, GCS, Dataflow, Apache Beam and BigQuery to create the complete pipeline end-to-end.
Data Warehouse ArchitectureData WarehousingBig DataETLSQLApache Kafka+1

Xpressbees (busybees logistics solutions pvt. ltd.)

Lead Data Engineer

Aug 2021Aug 2022 · 1 yr · Pune, Maharashtra, India · Hybrid

  • Design, structure and develop data models for different business lines of the company. Further designing reports to fulfil various requirements of business, operations and finances.
  • Derive Proof of Concept for technologies to use for building Data Warehouse.
  • Implementation of Analytical database with fact and dimensional modelling.
  • Used Kafka, Debezium, AWS S3, Snowflake, Airflow, Quicksight to create the complete pipeline end-to-end.
Data Warehouse ArchitectureData WarehousingKafkaAWS S3SnowflakeAirflow+1

Elasticrun

3 roles

Lead Data Engineer

Promoted

Apr 2019Aug 2021 · 2 yrs 4 mos

  • Design, structure and develop data models for different business lines of the company. Further designing reports to fulfil various requirements of business, operations and finances.
  • Development of new framework for internal use to validate and maintain the sanity of development and the data being generated.
  • Complete implementation of Analytical database with fact and dimensional modelling.
  • Responsible for all types of reporting and dashboards with analytical and transactional databases.
  • Constantly involved in performance tuning, optimizations, reiterations, feature development for new use cases, scalability and efficient database handling.
  • Building end-to-end integration of UPI Payment option for Sales business. The role involves direct interaction with the client for proper working.
  • Handling multiple projects with different teams, managing all at once is an achievement. Currently leading a team of 7-10 members.
Data Warehouse ArchitectureData WarehousingPerformance tuningReportingUPI Payment IntegrationBig Data

Data Engineer

Promoted

Apr 2017Mar 2019 · 1 yr 11 mos

  • Reporting and Dashboard - Designed Logi-sights dashboard for proper analysis of performance and other metrics for different business lines. Presenting data in visualized chart for in-depth analysis.
  • Statistical Based Projection Model - Full development of the Predictive Modelling Project involving end-to-end design, implementation and deployment.
  • Considering related features according to the business needs, to project items to be used by Procurement Team.
  • Management Information System - End to end development of Business level finance PNL for the complex model of Ecommerce.
  • Adapter Integration - Developed flow to connect and update real time sync up to client system for proper handshake for the service that ElasticRun provides.
  • REST API Development - Created REST API layer over it to provide real-time and granular information of the metrics to field and central operations.
Data WarehousingDashboard DesignPredictive ModelingREST API DevelopmentData Analysis

Software Engineer

Jun 2016Apr 2017 · 10 mos

  • Reconciliation System – Single handedly designed and developed a data flow structure using ETL tool to populate insightful metrics used to monitor daily operations and performance. Further enhanced it with query based orchestration in ETL to facilitate financial data to accounts and business owners.
  • Mentor junior team members on software design and development, coding practices and strategies.
ETLData Flow StructureMentoringData Engineering

Samsung research institute bangalore

Student Trainee

May 2015Jul 2015 · 2 mos · Bangalore

  • Micro SD Emulator Enhancement: Enhance Micro SD Emulator Infrastructure to be able to do the following critical aspects – Measure different performance parameters more precisely – Enhance Emulator to simulate Performance variations – Enhance Emulator to consider impact of Tprog, Tr NAND Timings.
Micro SD Emulator Enhancement

Education

Indian Institute of Technology (Banaras Hindu University), Varanasi

Bachelor of Technology (B.Tech.) — Computer Science & Engineering

Jan 2012Jan 2016

Emerald Heights International School

Class 10+2 — Mathematics and Science

Jan 2009Jan 2011

Laurels School International

Class 10 — ICSE

Jan 2003Jan 2009

Stackforce found 100+ more professionals with Data Warehousing & Big Data

Explore similar profiles based on matching skills and experience