Nikhil chennu

Senior Software Engineer

Hyderabad, Telangana, India9 yrs 10 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in designing scalable data engineering solutions.
Proficient in cloud automation and machine learning techniques.
Strong experience in developing ETL pipelines and data architectures.

Stackforce AI infers this person is a Data Engineering and Cloud Computing expert in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingMachine LearningBackend DevelopmentMicroservices

Other Skills

AWSAWS BatchAWS EMRAWS ServicesAirflowAlgorithmsAmazon DynamoDBAmazon Web Services (AWS)Apache KafkaApache SparkBI toolsCloud AutomationCode ReviewContainerizationData Analytics

About

• Experience in design, development and testing of applications. Development experience in Python and Golang • Good Knowledge in Algorithms and Data Structures. Loves taking up challenges and getting them done. • Comprehensive knowledge of cloud platforms such as Amazon Web Services(AWS).Engineered and Developed various cloud automation solutions using AWS platform and python. • Involved into designing and developing ETL data pipelines using spark, airflow, snowflake, delta lake and AWS services. • Experience in developing various stages of application like authentication (JWT mechanism), Design and development of various modules of application in optimized and reusable manner. • Used message brokers like Kafka & NATS with different patterns as queues, publish/subscribe and streaming. • Used various NOSQL & SQL databases like MySQL, Postgres, Elastic Search, influx db and ClickHouse. • Good Experience using different supervised and unsupervised Machine Learning Algorithms based on Regression, Clustering, Classification and Dimensionality Reduction techniques. Technology Stack: Python, Golang, Docker, Kubernetes, Redis Cache, Kafka, SPARK and AWS Cloud

Experience

9 yrs 10 mos

Total Experience

2 yrs 5 mos

Average Tenure

4 yrs 3 mos

Current Experience

Coinbase

Senior Software Engineer - Data Platform

Mar 2022 – Present · 4 yrs 3 mos

Ownership of Designing and Implementing a scalable framework for GDPR policy application over customer data residing in OLAP stores (Snowflake and Deltalake), which helps organisation to comply with GDPR policies across nations.
Managing various ETL paradigms ( Snapshot based, incremental load , Full Load, CDC) using airflow, AWS Services, Spark, Streaming, Databricks, Snowflake and Delta Lake.
ETL blockchains to snowflake for enabling analytics over blockchain structures.
Worked on building Data Mart for HR Data using Data Vault 2.0 modelling, which involves data life-cycle and access management from building raw, parsed and business tables using S3, Snowflake and exposing to the BI tools. This enabled historical view over the HR information which is not present before.

ETLSnowflakeDelta LakeGDPRAirflowAWS Services+4

Joveo

Software Engineer - Machine Learning

Oct 2020 – Mar 2022 · 1 yr 5 mos · Hyderabad, Telangana, India

Responsible for developing various batch and event based ETL pipelines using spark, python, AWS Batch and AWS EMR, processing enrichments for millions of records per day.
Built machine learning model inference pipelines exposed over rest API using async based framework Fast API.
Optimised run times of various micro-services using concurrent / parallel processing and part of migration of micro-services to Kubernetes which provides better availability and visibility.
Introduced data-dog and log-entries based monitoring and alerting for production pipelines which provided visibility over expected load in different dimensions and failures happening in production environment.

ETLSparkPythonAWS BatchAWS EMRFastAPI+3

F5 networks

Software Engineer

Jul 2019 – Sep 2020 · 1 yr 2 mos · Hyderabad Area, India

Part of NGINX Controller analytics module development team, enabling better monitoring & management of metrics/events data and providing API driven development support.
Worked on containerized and microservices based architecture, enabling different REST based API's and gRPC based communication between services, using golang .
Managed authentication using JWT tokens , metrics/events processing using NATS / Kafka message brokers
Developed a monitoring system which analyzes traffic based on moving averages, over different nginx agents using python.
Skills Used : Python , GoLang, Analytics and Containerization powered by kubernetes, NATS and Kafka (streaming and Publish/Subscribe)

PythonGoLangKubernetesNATSKafkaBackend Development+1

8k miles software services ltd

Software Engineer

Jun 2016 – Jun 2019 · 3 yrs · Chennai Area, India

Engineered and Developed cloud automation solutions using python programming , AWS cloud and machine learning techniques like clustering, regression, neural networks and dimensionality reduction
Worked on Various AWS services like EC2, Lambda, AWS Batch, IAM, CloudWatch, API Gateway, S3, Elastic Search, Elastic Cache (Redis) and Dynamo DB.

PythonAWSMachine LearningCloud AutomationCloud Computing

Iiitdm kancheepuram

Sumer Research Intern

Jun 2016 – Jul 2016 · 1 mo · Chennai Area, India

This Research Internship experience introduced various concepts of data mining and worked on a research problem "Image Compression using Pattern Mining"
https://www.researchgate.net/publication/328372307_Lossy_Image_Compression_using_Frequent_Pattern_Mining_based_Huffman_Encoding