Gaurav Verma

Software Engineer

United Kingdom11 yrs 4 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Over 9 years of experience in data engineering.
  • Expert in architecting scalable data solutions on AWS.
  • Proven track record in managing high-performance data platforms.
Stackforce AI infers this person is a Data Engineering expert in SaaS and cloud-based solutions.

Contact

Skills

Core Skills

Data EngineeringAwsData Platform ManagementMachine Learning

Other Skills

AWS GlueAWS LambdaActive ListeningAgile MethodologiesAirflowAmazon Elastic MapReduce (EMR)Amazon KinesisAmazon RedshiftAmazon Relational Database Service (RDS)Amazon S3Amazon Web Services (AWS)Apache AirflowApache KafkaApache PigApache Spark

About

As a Senior Data Engineer at AWS, I architect and implement data analytics and insights platforms using various AWS services and tools. I am passionate about building scalable and reliable data solutions that enable data-driven decision making and enhance business performance. I have a strong background in data engineering, with over 9 years of experience in the entertainment and travel industries. I have successfully managed data platforms consisting of Databricks, Airflow, Unified Data Catalogue, and Snowflake Cloud, running thousands of spark jobs and DAGs daily. I have also built Grafana dashboards for monitoring data platform health and quality. I have multiple certifications and awards in data processing, collections, and Hadoop foundations, as well as a B.Tech in Computer Science Engineering from IEC College of Engineering and Technology. My core competencies include Apache Spark, Scala, Python, ETL Pipelines, DataOps, MLOps and AWS.

Experience

Packt

Technical Reviewer

Feb 2023Oct 2023 · 8 mos · Remote

  • Did Technical review of content and code for Data Engineering on AWS Book by Packt
  • https://www.packtpub.com/product/data-engineering-with-aws-second-edition/9781804614426

Amazon web services (aws)

Senior Data Engineer

Apr 2022Present · 3 yrs 11 mos · Greater London, England, United Kingdom

  • Architecting and Implementing Data Analytics And Insights Platform using AWS
AWSData AnalyticsData Engineering

Skyscanner

Data Engineer 2

Oct 2021Apr 2022 · 6 mos · Greater London, England, United Kingdom

  • Managing Data Platform consist of Databricks, Airflow, Unified Data Catalogue
  • Scalable Airflow running 300+ DAGs
  • Daily 2000+ spark jobs running
  • Building Grafana dashboards for monitoring of Data Platform Health
DatabricksAirflowGrafanaData EngineeringData Platform Management

Discovery inc

2 roles

Senior Data Engineer

Mar 2021Oct 2021 · 7 mos · Greater London, England, United Kingdom

Data Engineer

Sep 2018Mar 2021 · 2 yrs 6 mos · Greater London, England, United Kingdom

  • Apache Spark I Scala | Python | AWS | Data Ops | Machine Learning
Apache SparkScalaPythonAWSData EngineeringMachine Learning

Tata consultancy services

3 roles

System Engineer

Promoted

Sep 2016Sep 2018 · 2 yrs

  • Spark | Scala Developer
SparkScalaData Engineering

Assistant System Engineer

Sep 2015Aug 2016 · 11 mos

  • Hadoop Developer
HadoopData Engineering

Assistant System Engineer-trainee

Sep 2014Aug 2015 · 11 mos

Education

IEC COLLEGF OF ENGINEERING AND TECHNOLOGY

B.tech — Computer Science Engineering

Jan 2010Jan 2014

Stackforce found 100+ more professionals with Data Engineering & Aws

Explore similar profiles based on matching skills and experience