Jun 2023 – Present · 2 yrs 9 mos · Noida · Hybrid

• ❖ Designed and implemented various real-time event streams, ingesting and processing over 50 million daily events to run user campaigns, achieving a 40% conversion rate.
• ❖ Analyzed, planned, and executed the migration of various high-volume production databases from HDFS to S3, implementing automation scripts in a Linux environment, resulting in increased scalability, durability, and $20000 in annual savings.
• ❖ Spearheaded the efficient ingestion of millions of Kafka events through the strategic utilization of Kafka topics and streams, resulting in a 40% increase in data throughput.
• ❖ Designed and developed an alerting system using PromQL rules integrated into Slack, boosting developer productivity by 30%, reducing debugging efforts by 40% and maintenance costs by $15,000.
• ❖ Achieved data compression using LZ4 and ZSTD for real-time data, with a compression ratio of 2.5:1, reducing the network overhead by 20% and lowering the storage costs by $25,000 annually.
• ❖ Utilized knowledge in Java, Apache Kafka, Linux scripting, Hadoop ecosystem, SQL and AWS.