May 2024 – May 2026 · 2 yrs · Bengaluru, Karnataka, India · On-site

Aug 2022 – May 2024 · 1 yr 9 mos · Bengaluru, Karnataka, India · Hybrid

• Responsible for Setting up Airflow & Snowplow clusters for different brands on GKE using Terraform for streamlined orchestration, and seamlessly integrating Git version control for CI/CD. This saved us 60% of the time it used to take for deploying everything.
• Designing and setting up CI/CD pipelines using Cloud Build to automate the build and deployments of Airflow Dags in the GKE Cluster.
• Setting up the BQ eviction policies which reduced the data storage cost by 70%.
• Implemented robust monitoring and alerting systems using Cloud Monitoring and Cloud Logging to proactively identify and address performance bottlenecks, errors, and anomalies in the data pipelines and applications.
• Responsible for setting up the In-house tool called API harvester which is a config driven solution that automates the API calls in Supermetrics which used to interact with multiple data sources like YouTube, Facebook, Instagram, etc.
• Responsible for Bigquery Slots Capacity & Planning for query jobs which helped in buying the optimal number of Bigquery slots for the project.
• Responsible for creating dashboard for Bigquery Jobs that consumed high slots, which helped in optimizing the scheduled query jobs.
• Responsible for setting up the CDN endpoint for snowplow tracker libs which are hosted in Cloud Storage that helped in reducing the bucket egress cost by 99%.
• Responsible for setting up the version controlled Data Service in Ascend using GitHub Actions which helped in keeping track of the Data flow code.
• Was responsible for setting up Data Mesh Architecture & migrating the Data with zero downtime to the respective brands.
• Participated in security audits & compliance assessments, ensuring adherence to industry standards and regulations

Jul 2020 – Aug 2022 · 2 yrs 1 mo · Bangalore Urban, Karnataka, India

• My core responsibility of managing about 10k+ servers (Physical,Virtual) with the following tech stack:
• Apache/Nginx | Haproxy | Mysql | NFS | Bind | Puppet/Ansible for Infrastructure code management | Git for config management | | KVM, XEN for Virtualization | FreeIPA for user management | Foreman for systems management
• Co-ordinating with other Engineering teams to setup the Infra.
• Migrated around 2k+ servers from one DC to another as a part of Datacenter Consolidation Project with a downtime of less than 1hr/server
• Responsible for automating all the manual and redundant tasks using Python and BASH
• Created an Internal tool for Inventory Management.
• Co-ordinated with Devs in setting up CI/CD Pipeline.
• Provided support to the Devs in-order to carry out mission critical dev releases.
• Actively participating in resolving major Incidents/outages for maintaining SLA's.
• Participating actively for 24x7 on-call responsibilities.

Jan 2020 – Jun 2020 · 5 mos · Bengaluru Area, India

• Build a POC on private cloud for EIG
• OpenStack
• Openshift
• Kubernetes
• Ansible