Apr 2022 – May 2023 · 1 yr 1 mo · Bengaluru, Karnataka, India

• Lead team of 6 engineers
• Collaborated with Product to understand requirements and break down tech use cases.
• Drafted many tech solutioning documents and got them reviewed over internal engineering forums.
• Actively participated in code reviews.
• Conducted Learning Series to learn new tech/tools.
• Motivated team to achieve 120% sprint delivery each time.
• Delivered organization quarter goals assigned to the teams.
• Achieved all assigned OKRs.
• Actively participated in hiring and scaled the team from 2 to 6 members.
• Handled people's issues by resolving them in the best possible way.
• Regularly update leadership with team engineering metrics and other aspects.

Jun 2021 – Mar 2022 · 9 mos · Bengaluru, Karnataka, India

• Build Data Platform [Kafka, BigQuery, Airflow, Java]
• Built Data Platform from Scratch to ingest data from various data sources to BigQuery.
• Used Airflow scheduler to maintain statefulness of the various data pipelines.
• Implemented custom alert mechanism to monitor Airflow pipelines failures. https://tech.bukuwarung.com/airflow-alerts-at-bukuwarung-5ef3b02add1c
• Introduced Kafka as the message broker across engineering. Built generic producer and consumer capabilities to eliminate code rewriting in every repository.
• Developed Reporting Platform as the backend for the user facing reports and reduced report latency from ~2 days to ~1 hour.
• Deployed Data Science pipelines to emit the results in near real-time.
• Performed multiple POCs on CDC platform, aggregate store, etc.
• Build User Trust(Risk team) [Kafka, Java]
• User Trust is the backend system for Risk aspects related to Transaction Monitoring.
• Built an internal rule engine system to analyze the transactions and flag them with various tags depending on maliciousness.
• Whitelist rule+user for genuine high value transactions from getting flagged.
• Completed integration with Bureau as a new rule engine and transaction analyzing tool.

Jan 2020 – Jun 2021 · 1 yr 5 mos · Bengaluru, Karnataka, India

• Worked on Mexico Market data

Feb 2019 – Nov 2019 · 9 mos

• Clickstream [Kafka, Flink, MySQL, Metabase, Java, Spark, Zeppelin, Airflow]
• Wrote jobs to dump data from beacon server DBs to storage buckets and spark jobs to load that data into MySQL warehouse and put Metabase as query layer.
• Wrote Airflow dags to automate this process for batch analysis. Use Kafka-Flink pipeline for powering real time dashboards.
• Use Zeppelin and EMR cluster for ad-hoc analysis. Created retention, acquisition and trend reports on Metabase for product teams.
• Data-Platform setup [AWS, GCP, AliCloud]
• Responsible for setting up complete data platform from scratch and scale for various country launches.
• Setup and maintain clusters like Zookeeper, Kafka, Alluxio, Presto, Metabase, etc.
• Setup SAR monitoring on data infra using netdata, jmxtrans, influxDB, grafana.
• Responsible to provide 99.5% uptime for data-platform.
• Improved Analytics [Alluxio, Presto, Metabase]
• Explored and setup Alluxio Distributed caching over storage buckets and enable Presto query engine to work over it using hive metastore integration. This replaced MySQL as data source in Metabase analytics and improved the query performance by ~70%.
• Corporate responsibilities
• Deeply involved in hiring process for Data and Core Engineering teams.
• Started blogging culture by starting Blog channel of Circles.Life -> https://medium.com/circleslife

Feb 2018 – Jan 2019 · 11 mos · Bengaluru Area, India

• Built data pipelines for Flights and Hotels persuasion elements using Flink, e.g, this flight is booked X times in last Y hours, etc.
• Maintaining reliability of Kafka cluster(implemented auth in Kafka and upgraded brokers to latest version available at that time).
• Implemented workload management in Redshift cluster.
• Built data pipelines around user personalisation, e.g. Payments preference personalisation, etc.
• Handling MySQL CDC pipeline via Debezium which powered many real-time products.
• Monitor Kafka consumer lags using Burrow which alerted individual owners of the kafka consumers to check for errors on their end.
• Built eventual consistent cache for hotel inventory and also wrote continuous integration test and auto-recovery pipeline for the same using Kafka Streams which reduced the average selling time for last room left to be ~20minutes.

Dec 2016 – Jan 2018 · 1 yr 1 mo

• Worked in Data Engineering team and work revolves around building applications around Kafka, Secor, Flink, Spark cluster, Zeppelin interpreter, etc.
• Worked on creating aggregation pipelines using Flink and analysing data using spark-scala code.
• Segmentation pipeline for drivers using Airflow scheduler and python & spark-scala code
• Doing open source stuff on Secor by Pinterest.
• Pickup Location and Null Searches analysis using Spark, which helps in improving user experience of product.

Jul 2016 – Nov 2016 · 4 mos

• Worked on Driver Rewards Service(Backend + UI) and Pricing Engine(UI).
• Technologies Used: Java, Postgres, Redis, HTML, Javascript

Feb 2016 – Jul 2016 · 5 mos · Bengaluru, Karnataka, India

• My work here revolved around BackEnd, mainly on Communication, User, OMS and Merchant services. Technology Used : Java, Maven, Dropwizard framework, MySQL.

Jul 2015 – Jan 2016 · 6 mos · Gurgaon, India

• My work here involved mainly on Algorithms for solving TSP and knapsack.
• Later on did some backend piece to implement Crawler.
• Worked closely with Operations team to solve Dangerous Goods problem via air transportation. Technologies used : Python, MongoDB, Redis, Disque.

Jan 2015 – Jun 2015 · 5 mos · Pune Area, India

• Worked on AP features, and developing some functionalities of the existing AirTight platforms. Work required sound knowledge of networking, including C, Shell Scripting, Java.
• Did exploration of WiFi Direct and IEEE 802.11k protocols.

Dec 2013 – Dec 2013 · 0 mo · Noida

• Understand all the security measures deployed in the organisation, and get friendly with the latest technology and security devices used.

Jul 2011 – Jun 2015 · 3 yrs 11 mos · Allahabad Area, India