Abhishek Kumar Kamal

Senior Software Engineer

Bengaluru, Karnataka, India6 yrs 11 mos experience
Highly Stable

Key Highlights

  • Expert in building scalable data platforms and MLOps.
  • Proven leadership in community development and team management.
  • Strong background in AI and real-time data processing.
Stackforce AI infers this person is a Backend-focused Data Engineer with expertise in SaaS and AI solutions.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingBackend DevelopmentData ScienceLeadershipCommunity DevelopmentFinancial Analysis

Other Skills

SQLKubernetesGCPTerraformKafkaFlinkMongoDBAzure Event HubPythonCNNDockerTeam BuildingMarketingFund ManagementRetrieval-Augmented Generation (RAG)

About

Senior Software Engineer with around 7 years of experience in backend, data, and platform engineering. I specialize in distributed systems, real-time data processing, and cloud-native platforms using Kafka, Flink, and GCP. My strengths lie in problem-solving, data structures, systems and database design, and building reliable, cost-efficient systems at scale. I currently work at Confluent, where I design and build production data platforms and ML pipelines. I hold a B.Tech from IIT Delhi with a Minor in Business Management and am an alumnus of Super 30. Outside of work, I enjoy reading books, playing chess, biking, and traveling. These hobbies help me relax and maintain a balanced life. Personal Background: I come from a small village named Gulariapur in Mainpuri District, Uttar Pradesh. Raised by modest parents, I completed my schooling at JNV, a network of government-funded residential schools. My upbringing taught me the value of hard work and family, a deep connection to rural life, and kindness towards all living beings.

Experience

6 yrs 11 mos
Total Experience
4 yrs 2 mos
Average Tenure
2 yrs 9 mos
Current Experience

Confluent

Senior Software Engineer

Sep 2023Present · 2 yrs 9 mos · Bengaluru · Remote

  • As part of the Applications and AI Engineering team within data team org, I worked on:
  • ◦ Built and automated an end-to-end MLOps platform for data science teams (data load→training→
  • evaluation→serving), with CI/CD pipeline deploying production-ready models in a single PR merge.
  • ◦ Designed and built RAG based intelligence platform that automatically collects, synthesizes, and
  • analyzes data about customer accounts to provide real-time, actionable insights to account team.
  • ◦ Developed cost-effective config-driven webhook service for real-time data ingestion into Confluent Cloud, deployed via CICD on GCP, utilized for sources like CommonRoom, Quartr, Zendesk, Jira etc.
  • ◦ Developed cost-effective, configuration-driven API-based data exporter service for ingesting
  • data into Confluent Cloud, utilized for Crossbeam APIs, with potential for future expansions.
  • ◦ Developed numerous Flink pipelines that power the entire backend of the Customer Intelligence Hub and Account Intelligence Platform—tools that provide a single, centralized view of customer engagement and success data for sales, account and field teams.
  • ◦ Created and managed Google Cloud & Confluent Cloud infrastructure using Terraform.
  • ◦ Developed Custom Kafka source connector(BYOC) for Confluent Cloud for Stripe, also installed
  • various existing managed connectors to sync data to and from various sources.
  • ◦ Designed a system to automate the export and deletion of unused tables and inefficient pipelines from BigQuery to Google Cloud Storage, resulting in monthly savings of around $5000.
  • ◦ Developed DBT metric store catalog UI & built CICD to deploy it as a static website on Google Cloud.
SQLKubernetesData EngineeringCloud Computing

Jio

2 roles

SDE, JioHealth, Jio Platforms

Apr 2020Sep 2023 · 3 yrs 5 mos

  • Worked as the backend Engineer:
  • ◦ Data Platform - Built Data pipelines and integrated Jio Big Data Lake(JBDL) for collection of all the user generated events. This PII stripped data repository gets used for Analytics, dashboards, BI, training AI/ML models and collaborations.
  • ◦ React.js: Developed various screens on Jio’s Covid19 portal where user can see real time Covid19 statistics and other pandemic related information which served 2 million+ DAUs; Developed web-app for symptom triage.
  • ◦ HMS/SMS-Integration-Service: Single handedly developed a service which reads diagnostic test’s data from MS-SQL table shared by partners, process it and send it to Digital Twin which is used to generate Covid Pass. Processes 200K+/Month test results
  • ◦ Centralised Event Platform: Wrote event publisher & subscriber which has real time event driven architecture for passing the Digital Twin events to Jio Big Data Lake.
  • ◦ Vault: Integrated Vault(Hashicorp) with Consul as backend storage for managing and securing JioHealth secrets
  • ◦ Data Lake: Built Data pipelines for event driven Service Level Logging(of services & micro-services) and integrated it with azure eventhub. This PII encrypted Data will be used for Analytics, dashboarding & Business Purpose.
  • ◦ ABDM: Led the integration of Ayushman Bharat Digital Mission with JioHealth to bridge the existing gap amongst different stakeholders of Healthcare.
  • ◦ JioHealth Cloud Architect: Worked on t develop the reconciliation platform which will enable segregation of resources usage on partner, corporate & user basis.
MongoDBKubernetesBackend DevelopmentData Engineering

Data Scientist, AI Centre of Excellence, Jio Platforms

Jul 2019Apr 2020 · 9 mos

  • Built multi-lingual, multi-modal AI enabled digital solutions @ scale for India #AiForIndia:-
  • ◦ Back-end: Wrote numerous AI driven services and microservices in python, secured them using different cryptographic algorithms, built CI/CD pipeline on Azure DevOps and deployed Dockerized services virtual server machine.
  • ◦ Face-match using triplet loss, CNN: Implemented CNN model which learns a mapping from face images to a compact Euclidean space where distances directly correspond to a measure of face similarity with real-time data.
  • ◦ Image Classifier: Implemented CNN model for Medicine Image Classifier.
  • ◦ React Native; Machli App: Developed and modified various screens of Machli, an app for fishermen.
  • The app got 10K+ downloads across 9 coastal states and 500+ DAUs within first 4 months and is winner of the prestigious Aegis Graham Bell Award & mBillionth Award.
  • ◦ Web scraping using Selenium and Beautifulsoup: Wrote statistics service for Covid-19 cases which
  • automated the scrapping of real time data(1M+ DAUs); Wrote extractors and processors which automated the extraction of data (grocery, medicine, Youtube videos) from various websites and ingest that in back-end platform.
  • ◦ Centralised Knowledge Platform: Worked on to build an extensive knowledge graph and data processing infrastructure at scale to power comprehensive and accurate data science services.
MongoDBKubernetesData ScienceBackend Development

Gny capital

Technical Analyst Intern

May 2018Jul 2018 · 2 mos · Noida Area, India · On-site

  • Technical Analyst - Financial Markets Research:
  • Automated fund research and analysis, monitored the core portfolio, and created an algorithm for model portfolios and stock value indexes.
  • Developed Python scripts for data extraction from Bloomberg Excel extension for numerous tickers.
  • Automated research and analysis of Cross Asset and sentiments, conducted quantitative fund analysis, and implemented the Heikin Ashi Algorithm.
  • Recognized with an increased stipend, performance bonus, and a letter of recommendation from the managing director.
PythonFinancial Analysis

Jansevak foundation, ngo

Co-Founder and President

Jul 2016May 2019 · 2 yrs 10 mos · New Delhi Area, India

  • As NGO Co-Founder and President:
  • Led teams in strategy, PR, marketing, and fund management.
  • Conducted skill workshops for 150-200 families in rural Uttar Pradesh.
  • Established successful cottage industries through the 'Svavalamban' project, aiming for self-reliance and constant income for villagers.
  • Designed an organizational structure for self-sustained cooperative societies.
  • Conducted market research, performed SWOT analysis, and led awareness campaigns to establish self-sustaining cottage industries in villages.
  • Increased the incomes of more than 100 families by 200%.
LeadershipTeam BuildingCommunity Development

Board for sports activities (bsa) iit delhi

Athletics Captain

Jul 2016Jun 2018 · 1 yr 11 mos · Delhi, India · On-site

  • Shivalik Hostel- Athletics Captain:
  • Led and guided the hostel team to achieve an impressive overall 2nd position in the Championship, securing 3 gold, 3 silver, and 2 bronze medals.
  • Elevated Shivalik Hostel's Athletics standing from no position the previous year to a commendable 2nd position overall.
  • Received the "Significant Contribution to Sports Activities" award from the warden for instilling a strong sports culture in the hostel.
LeadershipTeam Building

Education

Indian Institute of Technology, Delhi

Minor Area in Business Management

Jul 2017Jun 2019

Indian Institute of Technology, Delhi

Bachelor of Technology - BTech

Jan 2015Jan 2019

Super 30(Founded and managed by Mr. Anand Kumar)

IIT JEE Preparation

Jan 2014Jan 2015

Jawahar Navodaya Vidyalaya - JNV

Class 6th to Class 12th — Schooling CBSE Board

Jan 2007Jan 2014

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience