Bhavik Patel

Product Engineer

Dublin, County Dublin, Ireland9 yrs 9 mos experience

Highly Stable

Key Highlights

7+ years in software development and distributed systems.
Led artifact distribution to 200K servers in under 5 minutes.
Expert in AWS technologies for data processing.

Stackforce AI infers this person is a Backend-heavy Infrastructure Engineer with expertise in SaaS and distributed systems.

Contact

Skills

Core Skills

AwsDistributed SystemsSite Reliability EngineeringPython

Other Skills

AWS EMRAWS LambdaAlgorithmsAmazon EC2Amazon SQSApache SparkArtifact DistributionAthenaAuto-remediationCC++CeleryCheckstyleComputer NetworkingContainerization

About

Software Development Engineer with 7+ years of experience working on distributed systems with a good understanding of software development lifecycle. As a software engineer at AWS, I develop back-end solutions for data ingestion platforms for the Aurora Data Lake team. I work on distributed systems that process a few Petabytes of logs every day, using AWS EMR, Athena, Glue, Spark, HDFS and other technologies. Previously, I was a senior site reliability engineer at LinkedIn, where I led a project that enabled artifact distribution to 200K servers in three data centers within 5 minutes. I also worked on scaling and optimizing SaltStack for remote execution and auto-remediation. I am passionate about building scalable and reliable systems that can handle massive amounts of data and deliver value to customers. I enjoy collaborating with other teams and stakeholders to understand their needs and provide solutions that meet their expectations. I am always eager to learn new skills and technologies that can enhance my performance and career growth.

Experience

9 yrs 9 mos

Total Experience

3 yrs 11 mos

Average Tenure

1 yr 10 mos

Current Experience

Amazon web services (aws)

Software Engineer

Aug 2021 – Jul 2024 · 2 yrs 11 mos · County Dublin, Ireland

AWS Aurora Data Lake Team.
Working on a project which is responsible for processing PBs of logs every month. We accomplish
this by using AWS product like EMR, Athena, Glue, Spark and HDFS.

AWS EMRAthenaGlueSparkHDFSAWS+1

2 roles

Senior Site Reliability Engineer

Promoted

Apr 2018 – Aug 2021 · 3 yrs 4 mos

I am primary owner of a service which is responsible for artifact distribution to all servers in three
data centers. This service is a python tech stack, well crafted code, user facing api/cli and onbox agents installed on all LinkedIn data centers. This service leverages torrent library to distribute artifacts to 200K servers with the SLA of 5 minutes. Currently, we have 18+ clients/customers (other teams at linkedin) with 12 as active customers.
Worked on saltstack for 200K+ servers setup. We use saltstack for remote execution and auto- remediation at scale. Since upstream saltstack was not able to scale more than 40K machines, I worked on the team which was responsible for scaling it for our biggest data center with 60K machines. Currently, It is handling 5000+ auto-remediation jobs, 1000+ kernel upgrades, 100+ on demand profiles and other minor jobs everyday.

PythonSaltStackTorrentArtifact DistributionSite Reliability Engineering