Shubham Baldava

Co-Founder

Bengaluru, Karnataka, India10 yrs 6 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Co-founded a successful data platform startup.
  • Launched India's largest short video app, Moj.
  • Expert in cloud-based data engineering solutions.
Stackforce AI infers this person is a SaaS and B2C data engineering expert with strong leadership in software development.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingData ProcessingSoftware DevelopmentTeam ManagementBackend Development

Other Skills

AWSAWS RedshiftAirflowAlgorithmsAndroidAndroid SDKApache CassandraApache HudiApache KafkaApache SparkAthenaBig DataBusiness IntelligenceCCSS

About

Building the future data platform called Datazip. Providing a end-to-end & no-code data engineering tools including ingestion, warehousing, transformation/processing & BI (business intelligence) in a scalable & reliable manner under one umbrella. The mission of Datazip is for you to focus on getting value out of data rather than spending time to manage & scale the data infrastructure. 7 years into the industry, got a lot of insights about origin of the raw data to final processed value adding data. I know the pain points around current technologies and hiring challenges in data engineering due to talent crunch. Technologies i have worked extensively : AWS, GCP, NoSql (Dynamodb, Cassandra), relational databases, Redshift, Databricks, Snowflake, spark, kafka, hudi, airflow, airbyte, python, scala.

Experience

Datazip

Co-Founder

Apr 2022Present · 3 yrs 11 mos · Bengaluru, Karnataka, India

  • We are working on a product called Olake (olake.io) :
  • Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL
  • checkout : https://github.com/datazip-inc/olake
AWSGCPNoSQLData EngineeringData IngestionData Warehousing+2

Gameskraft

Engineering Manager - Data

Oct 2021Apr 2022 · 6 mos · Bangalore Urban, Karnataka, India

  • Managing Data engineering pipeline, architecture & team
  • Worked on AWS Redshift, Athena extensively as well as with Databricks
  • Built incremental reconciliation service with payment gateway
  • Worked on data pipeline logging, alerting of existing data pipelines.
  • Took an initiative of migrating to Apache Hudi based datalake.
  • Took care of redshift migration & scaleout
AWS RedshiftAthenaDatabricksData PipelineData MigrationData Engineering+1

Paypay corporation

Data Engineer

Nov 2020Oct 2021 · 11 mos · Tokyo, Japan

  • Created RaaS (Reconciliation as a Service) &
  • Helped internal teams to use RaaS and move 70+ jobs to it.
  • used Apache Hudi, Airflow, Scala & Yaml based template models for easy RaaS usage by the teams.
  • One of the most successful data engineering projects in PayPay
Apache HudiAirflowScalaRaaSData EngineeringData Processing

Sharechat

Engineering Lead

Dec 2018Nov 2020 · 1 yr 11 mos · Bengaluru, Karnataka, India

  • 1. Joined as one of the early & core members.
  • 2. Scaled the content creation pod from 0 to 25 people.
  • 3. Helped the whole org to move from monolith to microservice
  • 4. Launched biggest short video app in India currently called Moj. (Scaled to 10m MAU in 3 months)
  • 5. Launced multiple features video compression, notification delivery improvements, camera+music library. karma points systems, creator monetisation & post-rendering service at a scale of 160m MAU.
MicroservicesContent CreationVideo App DevelopmentSoftware DevelopmentTeam Management

Works applications co., ltd.

2 roles

Senior Engineer

Promoted

Oct 2017Dec 2018 · 1 yr 2 mos

  • Role consist :
  • 1. Currently working for speed-up of ETL process used in Version-upgrade. achieved upto 75% time reduction using Apache Spark, Apache Cassandra.
  • 2. Good understanding of version-up with schema changes for NoSql.
  • 3. Achieved Eventual Consistency in Micro Service architecture for one of the products using Apache Kafka.
Apache SparkApache CassandraETLData EngineeringData Processing

Back End Developer

Oct 2015Oct 2017 · 2 yrs

  • Backend Engineer :
  • 1. Worked on Java tool using Spring framework to make version-upgrade easier, error-free.
  • 2. Provided the tool with Junit and Maven Surefire testing.
  • 3. Cassandra Data-modelling for first 8 month since i joined the company. Helped 5 teams with their data-models. achieved 200ms response time in some of them with upto 70% queries reduction.
  • Technologies worked on : Java, Spring, Apache Cassandra.
JavaSpring FrameworkCassandraSoftware DevelopmentBackend Development

Works applications

Internship

Dec 2014Jan 2015 · 1 mo · Tokyo, Japan

  • Created translation helper tool for translation of existing peoducts to English and Chinese

Education

National Institute of Technology Jamshedpur

Bachelor of Technology (B.Tech.) — Computer Science

Jan 2011Jan 2015

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience