Divjot singh

CTO

South Delhi, Delhi, India14 yrs 9 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • 14+ years in cloud computing and data engineering.
  • Expert in architecting scalable cloud solutions.
  • Proven track record in leading data engineering teams.
Stackforce AI infers this person is a Cloud Computing and Data Engineering expert with a focus on SaaS solutions.

Contact

Skills

Core Skills

Solutions ArchitectureSecurity ImplementationCloud Solutions ArchitectureData EngineeringInfrastructure DesignDevopsData ScienceMachine LearningBig Data AnalyticsEtl DevelopmentAutomationCloud Infrastructure

Other Skills

API SolutionsAnomaly DetectionApache SparkApache ZooKeeperBig DataCC++CUDACloud OrchestrationCore JavaCost EstimationsData AnalyticsData IngestionData ProcessingETL Operations

About

An information technology professional having around 14+ years of experience in cloud computing, Data Science, DevOps and Data Engineering I have worked on AWS, OCI, GCP and private clouds. Helping Clients architect and deploy their production applications in the cloud. Leading a team of Data Engineers and Developers and helping them design and architect production applications. Implemented a robust Data Catalog service for publishing, consumption and running analytics on diverse datasets in the OCI cloud. Implemented a detailed ETL pipeline for gathering structured and unstructured data (Camera Images and videos, Drones, GPS, Documents, Database connectors )from over 10+ diverse sources, processing and storing them in the Obejct store and RDMBS. Architectured integration with 3 vendors for data ingestion, and various teams across NEOM for consumption of Data. This involved processing incoming data, transforming it for storage and analysis, and further consumption by various clients.

Experience

14 yrs 9 mos
Total Experience
4 yrs 11 mos
Average Tenure
11 yrs 1 mo
Current Experience

Scry ai

6 roles

Director of Technology

Promoted

Sep 2025Present · 9 mos

Senior Solutions Architect

Apr 2021Aug 2025 · 4 yrs 4 mos

  • Project: GroundX DAM
  • ● Deployment of UAT and production Enviroments on the Backend and FrontEnd.
  • ● Evaluating Serurity requirements and implementing them like WAF, Secure protocols, Encryption.
  • ● Liaising with CISO office to comply with all security requirments defined.
  • ● Liaising with Vairous teams both internal and external to design on API solutions for automatic live ingestion and consumption of the images and videos assets the the platform.
  • ● Guiding and resloving day to day issues faced by the team on both the BE and the FE.
  • ● Working with the client to quantify various requirements and designing solutions to implement the same in the platform. Designing and working out the solutions with developers on the team.
  • ● Working with the client to handle day to day requests and issues faced by the platform users and working out solutions for them with the development team.
  • ● Design and monitor various activities like backup, restore , optimization of the platform and services, Ingestion of data etc.
  • ● Code reviews, design review with the developers.
  • ● Managing the operation of nuxeo platform and ensure it is working as expected at all times. Helping the developer to debug the code and implement various requirements as sent by the client.
  • ● Working on cost estimations, platform growth calculations etc. with the client.
  • ● Designing a scalable architecture for converting the platform into a SAAS model.
UATProduction EnvironmentsSecurity RequirementsAPI SolutionsCost EstimationsSolutions Architecture+1

Senior Solutions Architect

Promoted

May 2020Aug 2025 · 5 yrs 3 mos

  • Project: OCI Cloud Solutions for various projects in Neom
  • Working on design requirments for any new project deployment
  • Work with OCI and neom networking teams on requirements like CIDR request, compartments , VPN tunnel , server creation , Domain mapping etc.
  • Create the enviroment and hand it over to the devops.
  • Develop scalable architecture with Load Balancers, Multi region replication, etc.
  • Design an architecture to deploy Kubernetes clusters and applications.
  • Develop elaborate monitoring tools integration with OCI like Grafana and ELK stack for all services.
  • Successfully migrated Groundx and ENOWA Applications to OCI from the on-premise native cloud deployments (on Neom internal Data Centre)
  • Worked with OCI service - Object Store, Autonomous Database,
  • Implemented a robust Data Catalog service for publishing, consumption and running analytics on diverse datasets in the OCI cloud.
  • . Implemented a detailed ETL pipeline for gathering structured and unstructured data (Camera Images and videos, Drones, GPS, Documents, Database connectors )from over 10+ diverse sources, processing and storing them in the Obejct store and RDMBS.
  • . Architectured integration with 3 vendors for data ingestion, and various teams across NEOM for consumption of Data. This involved processing incoming data, transforming it for storage and analysis, and further consumption by various clients.
OCINetworkingKubernetesMonitoring ToolsETL PipelineCloud Solutions Architecture+1

Solutions Architect

May 2020Apr 2021 · 11 mos

  • Project: Smart City
  • ● Designed Infrastructure requirements for the IoT framework and created a solution prototype for the application.
  • ● Guiding and mentored a team of Devops engineers and resolved any complex issues encountered during provisioning of machines and application deployment.
  • ● Sprint planning, tasks creation and estimation of various application and devops requirements.
  • ● Designed and implemented security best practices for the applications and infrastructure.
  • ● Evaluated various tools and databases to best fit the Neom use cases and finalized it.
  • ● Guiding application developers on best practices and efficient code process.
  • ● Guiding data scientists during development of machine learning pipelines.
  • ● Analysed Application to take it from POC stage to production and formutaled set of tasks required.
  • ● Designed monitoring , backup/restore policies ,identity management for various applications and infrastructure.
IoT FrameworkSecurity Best PracticesMonitoring PoliciesInfrastructure DesignDevOps

Senior Data Scientist

Mar 2019May 2020 · 1 yr 2 mos

  • Project: ABB Data Analytics Pipeline
  • ● Developed anomaly detection and predictive maintenance pipeline for ABB products deployed at client premises.
  • ● Used MLflow to develop automated machine learning pipelines integrating a feedback loop for automated training.
  • ● Published white paper titled “Need for Data Quality in Industrial Datasets ”
  • ● Helped clients to analyze their datasets faster by developing spark data pipelines.
Anomaly DetectionPredictive MaintenanceSpark Data PipelinesData ScienceMachine Learning

Senior Data Scientist

Apr 2015Mar 2019 · 3 yrs 11 mos

  • Project: A web scale unstructured data analytics application
  • This proprietary application consists of various big data technologies, It processes large volumes of unstructured data mined from the web and a variety of other sources. The system finally presents the processed information and insights to its users in an interactive interface.
  • Brief:
  • Implemented Apache Nutch 2.3 Framework for crawling Cancer specific forums.
  • Implemented custom parsers using Jsoup library.
  • Used HBase as a backend Data store for Nutch.
  • Used Google Big Query Platform to make SQL like queries by exporting data from HBase.
  • Analysed forum data using classification algorithms and text mining.
  • Used Apache Hive for Data analysis over HBase.
  • Used Apache Spark for twitter sentiment analysis.
  • Lead a team of 5 developers.
  • Responsibilities and contributions:
  • Set up Complete end to end Web Crawling and scraping Infrastructure on Amazon Web Services.
  • Crawled more than 50 websites.
  • Developed an automated framework to gather twitter data and run sentiment analysis using spark.
  • Developed various predictions using various algorithms like SVM, Logistic regression, Naive Bayes.
  • Text Mining – string classification and building model for unstructured data.
  • Wrote and deployed code for Data manipulation, Exploratory Analysis, treatment of outliers and missing values, Data cleaning, Data De-duplication etc.
  • Wrote Feature Extraction using Gate Pipelines.
  • Responsible for deploying Machine Learning models on Production Cluster having 3 AWS dedicated nodes and 10 AWS spot machines.
Web CrawlingData ProcessingMachine Learning ModelsBig Data AnalyticsData Engineering

Kvantum inc.

Developer

Nov 2014Apr 2015 · 5 mos · Gurugram, Haryana, India

  • Brief:
  • Spark for real time processing of Advertising Data to get insights.
  • Developed an application to ingest CSV data into Cassandra and HDFS using Mule workflows.
  • Used Druid for aggregations and data analytics.
  • Used Redis as an in-memory database for storing different datasets.
  • Responsibilities and contributions:
  • Set up infrastructure for Cassandra and Redis backup and restore operations.
  • Mule for ETL operations and automation of Business Flows.
  • AWS infrastructure for development and production releases.
Data IngestionETL OperationsData AnalyticsData EngineeringETL Development

Impetus

2 roles

Senior Software Engineer(R&D)

Jul 2014Oct 2014 · 3 mos

  • Project 1: Nosql Database Design
  • Brief:
  • Explored ETL offloading for Big data
  • Made Job Flows in Talend to do Data Integration among various Databases
  • Explored various NoSQL databases
  • Exploring technologies/algorithms to transfer Composite data and relationships between various Databases(Both SQL and NoSQL including graph based Databases like Noe4j)
  • Responsibilities and contributions:
  • R&D on NoSQL Databases.
  • Developed POC's to implement functionalities of various NoSQL Databases.
  • Project 2: Parallel Programming and Video Analytics
  • Brief:
  • Explored various technologies for implementing General-purpose computing on graphics processing units (GPGPU) for Java Applications viz. CUDA, JCUDA etc.
  • Integral part of iLabs team and involved in various Intellectual Property initiatives.
  • Done a POC on integrating a demo algorithm for Fingerprint Matching running on a NVidia Graphics Processor (GPU) demonstrating up to 30% improvement when compared with a 8-core Intel(R) Core(TM) i7 Processors.
  • Used hadoop ecosystem and ported it to run on the GPU.
  • Achieved up to 10x performance benefit over 8 Core Intel i7 processor for a simple use case of matrix multiplication of 2 matrices. The performance benefit increases more as the complexity of computations increases.
  • Achieved up to 8.6x performance benefit when implemented a finger matching algorithm (fpreader) in CUDA for parallel processing on the GPU vs the java implementation running on an 8 Core Intel i7 processor.
  • Responsibilities and contributions:
  • R&D on new technologies related to hadoop and GPGPU.
  • Currently in process of porting more use cases for processing on to the GPU.
  • Major focus on solving big data problems using parallel processing on a GPU.
  • Understanding GPU architecture and memory management.
  • Optimize CUDA ported applications for increased performance.
PuppetLinuxCloud OrchestrationAutomationCloud Infrastructure

Software Engineer(R&D)

Jul 2011Jul 2014 · 3 yrs

  • Project 1: Volly - Pitney Bows - Automation using Puppet
  • Responsibilities and contributions:
  • . Worked on puppet implementation of new Modules.
  • Worked on Linux OS.
  • Automated deployment of cluster using puppet automation tool.
  • Wrote a script for automation for construction of Golden Image and Control Server.
  • One click cluster creation solution.
  • Centralized configuration.
  • Configure Puppet with LDAP.
  • Project 2: Volly - Pitney Bows - Development of Cloud Orchestration
  • Responsibilities and contributions:
  • Worked on Cloud Orchestration module.
  • Worked on Private Cloud implementation using VMware API and VIjava.
  • Managing VM using VMware vSphere.
  • Implemented support for Rackspace, AWS and Terre mark public Clouds.
  • Wrote a script for automation for construction of Golden Image and Control Server.
  • Implemented VRRP protocol using keepalived for load balancing and highavailability.
  • Writing haproxy configurations for HA.
  • Explored Cloud based technologies viz. openstack, VMware etc.
  • Private / Hybrid Cloud and Multi-cloud deployments
  • Used Rest Based Web Services for interaction between Java Layer and Other APIs.
  • Implemented Thread Pool Executer and multithreading for Graph Based Execution.
PuppetCloud OrchestrationAutomationCloud Infrastructure

Education

Birla Institute of Technology and Science, Pilani

Master of Technology - MTech — Data Analytics

Jan 2016Jan 2018

International Institute of Information Technology Bangalore

Post Graduate Diploma in Machine Learning and Artificial Intelligence December 2019

Jan 2018Jan 2019

Dr. A.P.J. Abdul Kalam Technical University

Bachelor’s Degree

Jan 2007Jan 2011

Stackforce found 100+ more professionals with Solutions Architecture & Security Implementation

Explore similar profiles based on matching skills and experience