Chitrartha Sur

Product Manager

Bengaluru, Karnataka, India12 yrs 11 mos experience

Highly Stable

Key Highlights

Expert in DataOps and real-time streaming solutions.
Proven track record in optimizing machine learning pipelines.
Strong experience in deploying and managing Hadoop clusters.

Stackforce AI infers this person is a DataOps Engineer with expertise in big data technologies and cloud integration.

Contact

Skills

Core Skills

DataopsBig DataMachine LearningData EngineeringCloud InfrastructureInfrastructure Management

Other Skills

NiFiBig Data TechnologiesCloud IntegrationMLSparkTezHiveElasticsearchKafkaHadoopAnsiblePythonScalaJupyterZeppelin

About

DataOps Engineer with experience in Spark, Kafka, ML Platform, Hadoop, Python, NiFi, Linux, AWS, DevOps and Kubernetes.

Experience

12 yrs 11 mos

Total Experience

2 yrs 3 mos

Average Tenure

1 yr 5 mos

Current Experience

Confluent

Senior Solutions Architect

Dec 2024 – Present · 1 yr 5 mos · Remote

O9 solutions, inc.

Software Architect [Dataops]

Nov 2019 – Dec 2024 · 5 yrs 1 mo

Developing entire life cycle for real time streaming solution using nifi/big data technologies across all the clouds as part for our integration framework.

NiFiBig Data TechnologiesCloud IntegrationDataOpsBig Data

Cloudera

2 roles

Senior Consultant

Promoted

Feb 2019 – Nov 2019 · 9 mos

Optimizing the ML spark/Tez/Hive jobs by more than 50%.
Production-isation of ML pipeline concepts delivery.
Deployed Elasticsearch with Kafka, Kafka-connect to connect with Hortonworks distro.
Deployed NiFi flows with for end to end Data pipeline solution.

MLSparkTezHiveElasticsearchKafka+2

Consultant

Feb 2018 – Feb 2019 · 1 yr

Deployment of Hadoop cluster across AZ through automation[Ansible].
Implemented automated benchmarking for Nifi, Hive, kafka and Hadoop catered to the application business need.
Implemented automated NiFi SSL and AD-kerberos integration on HDP/HDF clusters.

HadoopAnsibleNiFiHiveKafkaData Engineering+1

Teradata

2 roles

Sr. Technical Consultant

Promoted

Nov 2016 – Feb 2018 · 1 yr 3 mos · Pune Division, Maharashtra, India

Implemented POC of Machine learning use cases[Fraud detection, user anomaly, user segmentation] using python, scala and spark in Jupyter and Zeppelin.
Import/Export compressed data from RDBMS to Spark/HDFS by oozie/sqoop for Avro, JSON and ORC type of data.

Machine LearningPythonScalaSparkJupyterZeppelin+1

Associate Technical Consultant

Nov 2016 – Aug 2017 · 9 mos · Pune Division, Maharashtra, India

Project emphasized on categorizing the data using ETL from datalake with labels to Spark/Hive.
Implementing Spark,SBT environment with Hadoop on AWS.

ETLSparkHiveData Engineering

Dxc technology

Professional Delivery-1

Dec 2015 – Nov 2016 · 11 mos · Bengaluru, Karnataka, India

Involved in Design and Development of technical specifications using Hadoop technology.
Designing and automating in moving all log files generated from various sources to HDFS for ETL.
Written the Apache PIG scripts/Hive jobs to process the HDFS data. Use cases included: Demographic usage pattern of data, Reports generated for business teams.
Led the team of 7+ members for ad-hoc development work.
Implementing REST API based automation.
Committing code to Github and collaborating with team.

HadoopETLApache PIGHiveData Engineering

Tech mahindra

Software Engineer

Jun 2013 – Dec 2015 · 2 yrs 6 mos · Noida

Deployment of Hadoop Cluster Environment
configuration update, upgrade of hadoop cluster, change management, and transferring data from legacy DBs/Frameworks across all environments.
Working on server crashes, troubleshooting/ integrating user with LDAP.
Responsible for arranging & providing training to the new resources.
Responsible for maintaining cron jobs on infrastructure servers and also have a basic understanding of shell scripts.
Routine Maintenance Activities to maintain service/environment stability and availability of Linux & HP-UX of AT &T.

HadoopLinuxChange ManagementInfrastructure Management