Ayush Gupta

DevOps Engineer

Delhi, India8 yrs 7 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in Kubernetes deployment best practices.
Proficient in automating Hadoop cluster setups.
Strong problem-solving and communication skills.

Stackforce AI infers this person is a Big Data Infrastructure Engineer with expertise in automation and cloud technologies.

Contact

Skills

Core Skills

KubernetesAutomationHadoop

Other Skills

Active DirectoryAirflowAlgorithmsAnsibleApache KafkaApache NiFiApache RangerApache SparkApache ZooKeeperAzure Data FactoryBashC++CDHCassandraCloudera

About

As a Senior Devops Engineer I work on Implementing best practices on K8s for deployment of various applications, tools and databases across multi DC environment. Also , i am well versed with experience on automation using tools such as Jenkins, Ansible and helm charts. Expertise in setting up core/customize secured enterprise Hadoop cluster, automated cluster deployments and monitoring. Proficient in Cloudera Distribution of Hadoop and writing automation on Ansible. Well versed with Programming skills. Always looking for challenging tasks to best utilize my skills and practical knowledge. Good problem solving & communication skills.

Experience

Rakuten symphony

2 roles

Technical Lead

Promoted

Apr 2023 – Present · 2 yrs 11 mos

Senior Devops Engineer

Feb 2021 – Mar 2023 · 2 yrs 1 mo

KubernetesAutomationAnsibleJenkinsPythonCloudera+1

Airtel x labs

Software Engineer

Nov 2019 – Feb 2021 · 1 yr 3 mos · Gurugram, Haryana, India

Centurylink

2 roles

Consultant

Promoted

Aug 2019 – Nov 2019 · 3 mos · Noida, Uttar Pradesh, India

Big Data as a service (BDAAS) - Responsible for setting up Production ready Cloudera Distribution of Hadoop cluster and taking deployment related decisions.
Expertise in deploying secure clusters including Kerberos, TLS & Cloudera KTS/KMS for Data at rest encryption.
Proficient in cluster Upgrades (Cloudera Manager and CDH) including both minor and major version upgrades.
Integrating cluster with Active Directory or LDAP, managing users and groups.
Cluster expansion - addition of new nodes (commissioning & decommissioning).
Key contributor in developing code for automated deployment of CDH cluster on cloud.
Automation on Ansible - This includes automated deployment of VMs & Bare metals, Preparing hosts &
installation, integration of cluster with AD, implementation of Kerberos & TLS, configuring sentry, calculation of
different cluster configurations while deployment, migration of automation from RHEL 6 to 7.
Writing python automations using CM API - cancelling impala queries & yarn applications based upon filter
conditions, monitoring HA status for services such as Resource manager as per client requirement.
Cloudera Data science workbench (CDSW) – Addition of latest Data science tool by Cloudera in production
cluster & setting up different Anaconda environments for python2/python3.
Enabling Sentry for authorization and managing roles.
Spark Tuning - configuring executor memory and CPUs as per requirement, Hive query & memory optimization.
Monitoring Impala & Yarn applications, analyzing logs & troubleshooting issues.
Azure Data Factory-
End to end Pipeline Development in Data Factory
Cleaning, transforming & ingesting data in tables.
Scheduling & triggering pipelines, Monitoring daily scheduled pipelines.