D

Deepak Agrawal

Product Engineer

Bengaluru, Karnataka, India19 yrs 2 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Over 20 years of experience in distributed systems.
  • Expert in architecting cloud-native AI platforms.
  • Passionate about solving complex AI and data challenges.
Stackforce AI infers this person is a Cloud and AI Architect specializing in Data Engineering and AI solutions.

Contact

Skills

Core Skills

Data EngineeringMetadata ManagementData SharingCloud ArchitectureAi Data ManagementForecasting

Other Skills

Apache IcebergMetadata DiscoveryGovernanceIceberg StandardsData SecurityAI ServicesLangChainAI AgentsModel context protocolArtificial Intelligence (AI)Spring BootJavaSpringServletsDesign Patterns

About

I am a Principal Engineer and Architect with over 20 years of experience building massive-scale distributed systems and enterprise products. My background is rooted in "solid engineering"—developing core server-side systems using Java and Python—but my career has evolved into architecting cloud-native AI platforms on OCI and AWS. Currently, I am focused on the intersection of Agentic AI and Modern Data Architectures. I don’t just integrate APIs; I design autonomous Agentic Services that reason, plan, and execute workflows, backed by robust data lakehouses. My Core Focus: ☁️ CLOUD AI PLATFORMS (OCI AI STUDIO & FORECASTING) During my tenure as a Cloud Architect at Oracle, I helped build AI Studio (Health & AI Data), a privacy-focused platform for managing datasets and custom annotations for sensitive industries. I also architected the OCI Time-Series Forecasting Service from scratch, designing it to handle minute-level granularity for high-scale prediction workloads. 🤖 AGENTIC AI & GEN AI I am actively building systems using CrewAI, LangChain, and LangGraph. My work spans the full model lifecycle—from training and fine-tuning to rigorous model evaluation—ensuring LLMs are reliable enough for production. 🗄️ DATA ENGINEERING & LAKEHOUSES AI requires clean, unified data. At Cloudera, I am designing Apache Iceberg REST catalogs and Cloudera Metalake to stream metadata discovery across heterogeneous environments. I specialize in unifying data silos (Hive, HMS) to enable seamless analytics. I am passionate about solving the "hard problems" where Data Engineering meets Artificial Intelligence, transforming raw data into actionable, autonomous intelligence.

Experience

19 yrs 2 mos
Total Experience
2 yrs 11 mos
Average Tenure
2 yrs 4 mos
Current Experience

The apache software foundation

Apache Hive Contributor

May 2025Present · 1 yr 1 mo

Cloudera

Principal Engineer

Feb 2024Present · 2 yrs 4 mos · Bengaluru, Karnataka, India

  • 1. Cloudera Metalake: Cloudera Metalake is a centralised federated
  • Service designed to streamline metadata discovery, access, and governance across multiple heterogeneous Iceberg REST catalogs. It addresses the inefficiencies of managing multiple independent data catalogs by providing a unified endpoint, reducing operational complexity, and enhancing data security and governance.
  • 2. Rest Catalog (Data sharing): Rest catalog is an Iceberg standards unify open data service that allows
  • organisation to access structured or unstructured data from CDP catalog with zero data copy & movement.
Apache IcebergData EngineeringMetadata DiscoveryGovernanceMetadata Management

Oracle

Cloud Architect

Nov 2020Feb 2024 · 3 yrs 3 mos · Bengaluru, Karnataka, India

  • 1. Building a cutting-edge cloud-based AI data management platform that empowers customers to effortlessly add or create datasets with customized annotations. Our AI data service offers a secure and privacy-focused solution, especially for sensitive data such as medical records. We have made data security and privacy our top priorities, and our service incorporates configurable roles and fine-grained access controls, which enable customers to restrict access to sensitive data and allow access only to authorized personnel.
  • 2. Built OCI AI Forecasting Service from the scratch it is an innovative solution that provides customers with the ability to generate forecast results based on their own historical time-series data. It is part of a suite of AI Services (OCAS) that are cloud-native, highly available, and scalable. With this service, customers can bring in their data of various frequencies, ranging from daily to yearly, or even a minute level granularity, to build models. The service then leverages AI capabilities to produce accurate forecasts that are critical for making informed business decisions. The OCI AI Forecasting Service is a game-changer for businesses that require reliable and accurate forecasting to stay ahead of their competition.
AI Data ManagementCloud ArchitectureData SecurityForecasting

Salesforce

Lead Engineer

Jan 2019Nov 2020 · 1 yr 10 mos · Hyderabad Area, India · On-site

  • Developed a cutting-edge Salesforce Loyalty system that caters to the needs of both B2B and B2C customers. This innovative system has been designed to cater to the unique requirements of diverse industries such as retail, airlines, manufacturing, and healthcare. Our team has leveraged the latest technologies and industry best practices to create a robust and flexible solution that enables businesses to optimize their loyalty programs and enhance customer engagement.

Sap labs india

2 roles

Associate Development Architect

Jan 2018Dec 2019 · 1 yr 11 mos · Bengaluru Area, India · On-site

  • SAP Analytics Cloud (SAC) is a unified, cloud-based platform that integrates business intelligence, augmented and predictive analytics, and enterprise planning. It enables connection to diverse data sources for comprehensive data modeling and analysis, supporting the creation of interactive visualizations and reports to inform strategic business decisions. Functioning as a cohesive environment, SAC streamlines the entire data-to-insight lifecycle across an organization.
  • Key Contributions & Features
  • 1. Dashboard Development: Developed and implemented interactive dashboards, including private and public dashboards, to deliver essential business insights and a unified view of performance metrics.
  • 2. Third-Party Integration: Orchestrated the integration of the Highcharts library to augment the product's data visualization capabilities, resulting in the delivery of advanced and customized charting options.
  • 3. Data Lifecycle Management: Managed the complete data lifecycle, from initial data acquisition and structured modeling to the development of compelling data visualizations and comprehensive reports.
  • 4. Critical Issue Resolution: Diagnosed and resolved critical product issues and complex technical anomalies, ensuring product stability, enhancing reliability, and optimizing the user experience.
  • 5. Novel Feature Development: Initiated the development of a novel 'save without data' feature, enabling users to save dashboard layouts as reusable templates, thereby significantly enhancing workflow efficiency.

Senior Software Engineer

May 2014Dec 2017 · 3 yrs 7 mos · Bengaluru Area, India · On-site

  • SAP Usage Analytics & SAP Lumira
  • SAP Usage Analytics is a service that provides detailed cloud-based reporting and data visualization capabilities to monitor product adoption and user behavior. The service facilitates product registration and subsequently pushes usage data to a HANA database for analysis. This data is then visualized using SAP Lumira, a powerful software that enables the creation of interactive dashboards, charts, and infographics. My experience includes leveraging these tools to:
  • 1. Implement flexible usage tracking: Configured usage analytics for both standard and custom tracking, capturing key user data (e.g., browser type, OS) and custom-defined fields.
  • 2. Create dynamic visualizations: Transformed raw data from the HANA database into dynamic visualizations using SAP Lumira, delivering actionable insights through interactive maps, charts, and infographics.
  • 3. Streamline data-driven decision making: Contributed to the streamlining of data-driven decision making by importing data from a variety of sources, conducting visual BI analysis via intuitive dashboards, and facilitating the secure dissemination of data stories to project teams.

Dell emc

Team Lead

Dec 2012May 2014 · 1 yr 5 mos · Bangalore · On-site

  • Developed EMC Software Unique Identifier (SWID) service to allow the unique identification and tracking of installed or activated EMC licensed-enabled software products.
  • This tracking enables remote connectivity, which allows for better serviceability and enhanced customer quality.
  • Additionally, tracking software enables businesses to generate more revenue. With SWID values, businesses can easily manage their software inventory and ensure they are compliant with licensing agreements.
  • This project streamlines the process and make it easier for businesses to keep track of their software.

Paypal | ness technologies

Senior Software Engineer

Apr 2011Dec 2012 · 1 yr 8 mos · Chennai Area, India

  • As a Senior Software Engineer at PayPal (Ness Technologies), I played a pivotal role in key projects for PayPal, with a focus on risk compliance, payment processing, and data reporting. My work encompassed the development of robust back-end systems, the integration of third-party technologies, and the creation of data-driven dashboards to meet critical regulatory and business requirements. I leveraged my expertise in Java/JEE, C++, and various scripting languages to design, implement, and validate enterprise-level applications.
  • Project Highlights
  • 1. PayPal Davis Non-Reference Refund: Developed a system to automate non-reference transaction refunds. The system applied logic to place a temporary hold on funds, match transactions, and either automatically process the refund or queue it for user selection to ensure accuracy and compliance.
  • 2. Risk Compliance Monitoring Dashboard: Built a monitoring framework dashboard to track non-compliant transactions and users from various countries. The dashboard provided real-time insights and was capable of sending automated alerts via email and SMS to legal and regulatory teams.
  • 3. Risk Compliance Exception Processing: Implemented an automated daily process to extract and process restricted user data from a Teradata database. The system fed this critical information into the Norkom database, which was used to generate Suspicious Activity Reports for government regulatory bodies.
  • 4. International Funds Transfer Reporting: Created a data processing system to fulfill a mandate to report all international funds transfer data transmitted into or out of Australia. The process involved extracting user and transaction data from the Norkom database to generate detailed regulatory reports.

Ibm india software lab

Software Engineer

Feb 2007Mar 2011 · 4 yrs 1 mo · Bengaluru, Karnataka, India · On-site

  • As a Software Engineer, I was responsible for the analysis, design, and development of new features for the IBM Informix 4GL product. My contributions advanced the product's capabilities across multiple releases, enabling greater functionality for database application development. I leveraged my proficiency in C, C++, and scripting languages to ensure the product’s consistent compliance with established standards.
  • Key Contributions
  • 1. I4GL 7.32.xC4: Enabled the use of dynamic arrays and Bigint data types within 4GL programs, enhancing data manipulation capabilities.
  • 2. I4GL 7.50.xC1: Implemented support for UTF-8 character encoding, providing users with the ability to search, edit, and display multilingual characters in applications.
  • 3. I4GL 7.50.xC2 (SOA Enablement): Paved the way for service-oriented architecture (SOA) by enabling users to publish legacy business logic as web services, allowing it to be consumed by a wider range of applications.
  • 4. I4GL 7.50.xC3 (SOA Enablement): Extended SOA capabilities by enabling users to consume existing web services and business logic from other programming languages.
  • 5. I4GL 7.50.xC4: Introduced file I/O support, allowing 4GL programs to perform file-related operations such as OPEN, CLOSE, READ, WRITE, and SEEK.

Education

IIT Bombay

e-Postgraduate in Artificial Intelligence and Data Science

Jan 2026Jan 2027

Madhav Institute of Technology and Science, Gwalior

Bachelor of Engineering (B.E.) — Computer Science

Jan 2002Jan 2006

Stackforce found 100+ more professionals with Data Engineering & Metadata Management

Explore similar profiles based on matching skills and experience