Dipan Datta

DevOps Engineer

Bengaluru, Karnataka, India13 yrs 3 mos experience

Most Likely To SwitchAI Enabled

Key Highlights

12+ years of experience in Software Development and Automation.
Expertise in AI/ML, Data Engineering, and Cloud Platforms.
Proven track record in building intelligent automation frameworks.

Stackforce AI infers this person is a SaaS expert with strong capabilities in AI/ML and Cloud Engineering.

Contact

datta.dipan07@gmail.com LinkedIn

Skills

Core Skills

Ai/ml & Data EngineeringCloud & Big DataSoftware Quality & Testing

Other Skills

AWSAWS CloudAWS servicesApache HadoopAzureBig DataBig Data AnalyticsCDH/HDPCI/CDCitrix XenApp applicationsCommunicationCompatibility TestingCore JavaDTE(distributed Topology Environment)Docker

About

I am a deadline-oriented, performance-driven Technology Leader with 12+ years of expertise in Software Development, Test Engineering, and Automation across AI/ML, Data Engineering, and Cloud Platforms (AWS, GCP, Azure). With a proven track record of building intelligent automation frameworks, data pipelines, and AI-powered recommendation engines, I bring together deep technical expertise with strong team leadership and people management skills. Over the last 5 years, I have successfully led high-performing teams—mentoring engineers, driving innovation, and ensuring delivery of high-quality, scalable solutions. Core Strengths & Expertise AI/ML & Data Engineering – Neural networks, machine learning pipelines, recommendation engines, predictive analytics ETL & Automation – Data pipeline design, Python/Perl/Java automation, Unix shell scripting Cloud & Big Data – AWS, GCP, Azure, Hadoop, Spark, SQL/NoSQL, VMware Software Quality & Testing –Backend microservice, API, Database and ETL pipeline testing along with Web automation using Selenium WebDriver, Playwright, framework development, CI/CD test automation Leadership – Technical mentorship, cross-functional collaboration, project delivery excellence, performance management I thrive at the intersection of technology, quality, and leadership, ensuring cutting-edge solutions are delivered with speed, accuracy, and innovation. My vision is to build and lead teams that not only solve complex problems but also create measurable business impact.

Experience

Cloudera

Staff SDET- Machine Learning

Aug 2021 – Present · 4 yrs 7 mos · Bangalore Urban, Karnataka, India

Cloudera Machine Learning
AWS
Azure
Python
Apache Hadoop
Big Data

AWSAzurePythonApache HadoopBig DataAI/ML & Data Engineering+1

Mcafee

Senior Software Engineering

Jun 2019 – Aug 2021 · 2 yrs 2 mos · Bengaluru, Karnataka, India

AWS cloud development and automation(s3, ELB, cloud Front, API Gateway, API server, Terra-form, cloud formation, IAM, VPC, Route53, AWS Batch, codepipeline)
Big Data and analytics stack ( kafka, spark, kinesis, Elastic Search, RDS, Dynamo DB, Athena, MySQL, Hive, redis, Redshift)
Automation using advanced OOP Python3 and Node Js
Data Pipeline and data processing
CI/CD using Team city and cloud formation script
Framework Development using Python/ Pytest/ NumPy/ SyPy/ Mlib
Machine Learning for linear graph models and matrix computation for decision tree
Customer on boarding using Account provisioning and multi tenancy algorithm on op-prem and
cloud
E2E deployments on Dev-QA, Staging and Production
Bug fix and validation

AWSBig DataPythonNode JsCI/CDMachine Learning+2

Nokia & tivo

Senior SDET

Jan 2017 – Jun 2019 · 2 yrs 5 mos · Bangalore Area, India

Executing cloud based micro services using docker for SOA , data center runs and functioning with Jenkins for building/ executing codes & pipelines for CI and CD
Proactively facilitating end-to-end user experience, UI integration and the test flow for the same
Carrying out algorithm testing using data infusion methodology and recommending engine & analyzing data pattern using MLib and PyLib libraries from python
Developing and testing data consistency using performance modules including Grafana, python and core java
Streaming data using real-time feedback and implementing predictive analysis via Kafka jobs
Documenting Hive/HBase queries for mining data and performing ETL for engine recommendation
Developing design changes, system resiliency along with functional & performance testing and working on data security for predictive analytics
AWS lambda , S3, kinesis , ELK integration and automation using CLI, RDS and Redis
Carried out E2E big data predictive analytics platform testing that is presently under research and development
Followed the agile methodology and used various Hadoop components/ compute cluster components including HDFS, HIVE, Hbase with Spark in CDLK level, MR, DCOS, Kakfa, Flume, Cloud -AWS and CloudBand and other data lake & compute cluster architecture
Developed end-to-end automation using Python, Perl, Core java and automated test cases for Hive/Hbase/Impala post validation manually and loaded data/operated DDL & DML both internally/ externally with various file formats such as parquet & AVRO

DockerJenkinsKafkaPythonCore JavaAWS+2

Oracle

Member Of Technical Staff

Nov 2014 – Jan 2017 · 2 yrs 2 mos · Bangalore, India

Performed manual testing prior to the automation process and automated the test suit in core Java/PERL/SHELL and Python
Conducted Web UI testing of Oracle apps and used Selenium Webdriver along with Python and Java and prepared/ designed test strategies, plans and other test cases efficiently
Engaged in reviews/ requirements of projects and other designs of the documents and daily scrum calls
Examined and inspected the tests, production failures and analyzed the causes for the same and generated bug reports
Collaborated with the development teams and resolved defects with the system & services and recommended feedback for improvements in product solutions, tools and other features of the technical software
Managed the test coverage reports for functional/ automation purposes, inventories of scrum test case and maintained the automation framework
Utilized Perl/Python/Shell/Java for automation purposes

SeleniumPythonJavaPerlShellSoftware Quality & Testing

Cognizant

Programming Analyst

Dec 2012 – Nov 2014 · 1 yr 11 mos · Bengaluru Area, India

Executed Unix shell scripting, and requested changes in the java scripts and tested in the DEV, SIT and UAT environments
Constantly met the client's business/ technical requirements, performance tuning and oversaw the Sybase stored proc changes for the same
Worked on Migrating Sybase Stored procs to InformaticaPowercenter 9.5
Tested the production environment code bugs and analyzed the cause of issue in DEV, SIT and UAT environments and fixed the same
Oversaw and managed the database development ranging from assessment to QA/QC, designing and support and improvised the change requests for Informatica Powecenter mapping performance
Deployed the Unix, Sybase and ETL changes in the lower environments

UnixSybaseInformaticaPowercenterETL