Anjali .

DevOps Engineer

Bengaluru, Karnataka, India11 yrs 3 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in designing ETL pipelines for security monitoring.
  • Proficient in Python for automated security alerts.
  • Experience in managing big data projects across multiple countries.
Stackforce AI infers this person is a Big Data Engineer with expertise in Cybersecurity and Data Management.

Contact

Skills

Core Skills

Big DataPythonElasticsearchApi DevelopmentDatabase Management

Other Skills

AWS GlueAmazon Web Services (AWS)Application TestingBig Data AnalyticsBitbucketCascading Style Sheets (CSS)Data CleaningDatabasesETL pipelineFlaskGithubGoogle AnalyticsHTMLJSONJava

About

Experienced in ETL pipeline with Kafka and elasticsearch. Bigdata lead role at Yokogawa to develop a global SOC(Security Operation Center). Have good experience in Python for the development of automated security alerts and also worked as a Python Developer in Wipro.

Experience

Prodapt

2 roles

Technical Lead (Big Data)

Oct 2023Present · 2 yrs 5 mos

Lead Engineer(Big Data)

Jul 2021Present · 4 yrs 8 mos

Yokogawa india limited

Big Data Engineer

May 2019Jul 2021 · 2 yrs 2 mos · Greater Bengaluru Area

  • Understands the global SOC requirement and designed an ETL pipeline for live monitoring of security logs.
  • Analyzed data-related systems integration opportunities and challenges in analytics of different types of logs from 15 different countries using ELK stack.
  • Played a key role in understanding the required uses of the data involved in the project and leads to the creation of the data mapping, models, and reporting needed to meet the project needs.
  • Configured Analysed data in graphs and charts to display in the Kibana dashboard for security experts.
  • Created real-time alerts system to detect suspicious activities from logs and linked it with mail-server using python.
  • Researched and developed machine learning jobs for security problems, in the areas of networking, application & data with the help of in-build ML modules in Elasticsearch.
ETL pipelineKafkaElasticsearchdata integrationdata mappingKibana+2

Wipro

3 roles

Senior Software Engineer

Promoted

Jan 2018Apr 2019 · 1 yr 3 mos

  • Develop a search for 5 crore data.
  • Getting results in less than 200 milliseconds for search data.
  • Develop a search API over elasticsearch api.
  • Indexing 2-3 crore daily in Elasticsearch with the help of logstash.
ElasticsearchAPI developmentdata indexingsearch optimizationAPI Development

API developer and database management

Aug 2016Apr 2019 · 2 yrs 8 mos

  • Work on digital ocean server which is linux based server.
  • Create database which stores 150Gb of data.
  • Python script for sending data from xml, json and csv file to Mysql server
database managementPythonLinuxDatabase Management

Software Developer python

Nov 2014Apr 2019 · 4 yrs 5 mos

  • Working With python flask to develop rest API.
  • Working with File system with python to stream to the different database
  • Optimize python code by implementing python code in spark
PythonFlaskREST APISparkAPI Development

Education

Atma Ram Sanatan Dharam College

B.sc computer science ( Hons ) — Computer Science

Jun 2011Jun 2014

Vellore Institute of Technology

Master of Technology - MTech — Computer Science

Stackforce found 100+ more professionals with Big Data & Python

Explore similar profiles based on matching skills and experience