Yash Sharma

VP of Engineering

Sydney, NSW, Australia16 yrs 5 mos experience

Most Likely To SwitchAI ML Practitioner

Key Highlights

Led development of massively scalable storage platforms.
Built multi-tenanted data lake for Atlassian Analytics.
Developed recommendation systems for FinTech applications.

Stackforce AI infers this person is a SaaS and FinTech expert with strong capabilities in data platforms and machine learning.

Contact

yash360@gmail.com LinkedIn

Skills

Core Skills

LeadershipAiRegulatory ComplianceStorage PlatformData LakeBig DataMachine LearningFintechSoftware DesignJava Enterprise EditionWeb Services

Other Skills

AJAXAlgorithm DevelopmentAmazon Web Services (AWS)Analytics PlatformApache PigApache SparkClassificationCollaborative FilteringControl PlaneCross-functional CollaborationsData PlatformData QualityData ResidencyEngineeringFedRAMP

About

Manager of Platforms and Teams - both High Performing !! Solving foundational complexities for business. I build and lead high performing Data, ML & Storage Platforms. I specialize in high volume, massively scaled platforms built with array of distributed systems and cloud technologies.

Experience

16 yrs 5 mos

Total Experience

3 yrs 5 mos

Average Tenure

10 yrs 5 mos

Current Experience

Atlassian

3 roles

Senior Engineering Manager, Gen AI Platform

Oct 2023 – Present · 2 yrs 8 mos

LeadershipPlatform engineeringCross-functional CollaborationsTeam DirectionAIGenerative AI

Engineering Manager, Storage Platform

Promoted

Jan 2021 – Oct 2023 · 2 yrs 9 mos

Leading foundational engineering teams building new generation Storage Platform for Atlassian.
● Leading Atlassian’s massively scalable, Multi-tenanted, Multi-cloud, Transactional & Binary Storage Platform’s development.
● Building Managed Storage platform built to host all flagship Atlassian products like Jira/ Confluence/ Loom attachments, hosting 50+ Petabytes of data.
● Planning and Executing large scale migration of multi Petabyte data from traditional Atlassian systems to new generation platform.
● Delivering Atlassian’s largest cloud commitments, Data Residency/BYOK Encryption/ FedRamp embedded in Platform. (https://www.atlassian.com/roadmap/cloud?category=compliance)
● Cross-functional collaboration to deliver and unblock large-scale projects. Define team strategies aligned with company priorities.

Regulatory ComplianceSOC2FedRAMPStorage PlatformData PlatformHIPPA+3

Senior Platform Engineer | Data Platform

Jan 2016 – Jan 2021 · 5 yrs

Involved in developing & delivering multiple highly critical and high volume Data Platform Projects.
Some to list -
● Developed Atlassian’s customer facing multi-tenanted data lake. This was launched as a new product Atlassian Analytics announced in Atlassian Summit.
● Founding member of Atlassian’s internal Data Platform.
● Built self-serve system Metrics Central for computing and tracking Atlassian’s critical business metrics.
● Built self-serve Data Quality framework for scheduled SQL and no-code checks on data lake tables.

Data QualityData lakeBig DataApache SparkMetricsAnalytics Platform+2

The apache software foundation

4 roles

Open Source Contributor | Apache Spark

Jan 2016 – Sep 2018 · 2 yrs 8 mos

Apache Spark is a fast and general engine for large-scale data processing. Contributing to Apache Spark and Kinesis integration for better failure recoveries in realtime applications.

Committer & PMC Member | Apache Lens

May 2015 – Jan 2016 · 8 mos

Lens provides an Unified Analytics interface. Lens aims to cut the Data Analytics silos by providing a single view of data across multiple tiered data stores and optimal execution environment for the analytical query. It seamlessly integrates Hadoop with traditional data warehouses to appear like one.

Open Source Contributor | Apache Calcite

Oct 2014 – Apr 2015 · 6 mos

Calcite is a highly customizable engine for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database.

Open Source Contributor | Apache Drill

Jun 2014 – Dec 2015 · 1 yr 6 mos

Apache Drill by Apache Foundation is the first open source implementation of the Google’s Dremel paper for interactive query processing. Apache Drill provides low latency ad-hoc queries to many different data sources & nested data. Drill is designed to scale to 10,000 servers and query petabytes of data in seconds.

Snapdeal

Senior Platform Engineer | Data & ML Platform

Feb 2014 – Jan 2016 · 1 yr 11 mos

Scaled India's largest marketplace's Data & ML platform.
● Built Data Lake backed Feature Store that refreshed on schedule and was source of truth for offline model training. This was pivotal in creating a Recommendation Platform serving larger company initiatives.
● Built low touch and configurable Recommendation Platform for Snapdeal’s data. Platform was used to create Personalised User Feed for ~10M daily unique users.
● Recommendation Platform was also used to productionise Trending Products & Viewed-Also-Viewed features which got prime real-estate on home page and product pages.
● Developed Data Platform capabilities and Streaming Ingestion system for the Indian e-commerce giant

HadoopMachine LearningBig DataApache Spark

Impetus

Software Engineer

Aug 2012 – Feb 2014 · 1 yr 6 mos · Bengaluru Area, India

Impetus is a BigData service provider for customers worldwide. Worked for the Banking Leader American Express for their machine learning initiatives.
● Built recommendation system for American Express based on collaborative filtering
● Built a fuzzy match algorithm for American Express Vendor base and Local business to provide top deals to consumers and encouraging local shopping
● User Behaviour analysis and Fraud Classification

HadoopMachine LearningMahoutCollaborative FilteringFinTechBig Data+4

Sap labs

Software Engineer, Web Services

Feb 2012 – Aug 2012 · 6 mos · Bangalore

Worked on SAP Duet Enterprise for Microsoft SharePoint, a new, jointly developed product from SAP and Microsoft that enables interoperability between SAP applications and Microsoft SharePoint Server 2010.
● Developed system providing REST integration between Microsoft products and SAP
● Developed connector for Microsoft Sharepoint with SAP backend

EngineeringSoftware InfrastructureSoftware Design