Akash Dwivedi

Senior Software Engineer

San Francisco, California, United States14 yrs 9 mos experience

Highly Stable

Key Highlights

Expert in backend engineering and cloud infrastructure.
Led development of scalable data orchestration platforms.
Strong experience in big data technologies and distributed systems.

Stackforce AI infers this person is a Backend Engineer specializing in SaaS and Big Data solutions.

Contact

Skills

Core Skills

Data Platform OrchestrationSoftware EngineeringBackend EngineeringCloud InfrastructureData EngineeringBig DataData Management

Other Skills

Workflow Scheduling PlatformETL/ELTML workloadssoftware designdevelopmentWorkflow SchedulingETLMLdistributed graph algorithmscloud-native infrastructuretenant provisioningauthenticationaccess controldata ingestionquery layer

Experience

14 yrs 9 mos

Total Experience

3 yrs 9 mos

Average Tenure

1 yr 11 mos

Current Experience

Airbnb

Staff Software Engineer - Workflow Orchestration

Jun 2024 – Present · 1 yr 11 mos · San Jose, California, United States · Remote

Netflix

Senior Software Engineer- Infrastructure - Data Platform Orchestration

Sep 2020 – Jun 2024 · 3 yrs 9 mos · Los Gatos, California, United States

- Workflow Scheduling Platform: Inhouse workflow orchestration engine that helps 1000's of users and multiple platforms to orchestrate ETL/ELT, ML workloads at scale. Involved in the software design and development of core features of the product.

Workflow Scheduling PlatformETL/ELTML workloadssoftware designdevelopmentData Platform Orchestration+1

Splunk

2 roles

Principal Engineer

Promoted

Nov 2019 – Sep 2020 · 10 mos

Backend engineer for Splunk Process mining product. Involved in the software design and development of core features of the product from the starting of the project. Participation in defining the architectural design and process. Closely worked with customers for product requirements and support.
Designed and developed distributed graph algorithms for flow graph data ingestion from event logs, flow graph analysis, data processing, graph transformations, graph aggregations, and funnel analysis on the resulting process flows. Developed cloud-native infrastructure to run the workloads.
Designed and Developed services for tenant provisioning, authentication, access control, data ingestion, query layer and commit to production CI/CD pipeline (Jenkins and GitLab)
Technologies used: Golang, Druid, Kubernetes, Java, Python, AWS AWS (S3, EC2, DynamoDB), Terraform, Gitlab
Open sourced K8s Druid operator and feature enhancements for Druid operator. (https://github.com/druid-io/druid-operator)
Customer visits to beta test and plan future product functionality.

Backend engineeringdistributed graph algorithmscloud-native infrastructuretenant provisioningauthenticationaccess control+5

Senior Software Engineer

Mar 2018 – Nov 2019 · 1 yr 8 mos

Flurry analytics

Senior Software Engineer

Dec 2015 – Feb 2018 · 2 yrs 2 mos · San Francisco Bay Area

Engineer at Platform team in Flurry
Feature enhancements and Open source contributions for Druid.
Manage and develop features for Druid, HBase and Airflow
Handle PB scale Hadoop clusters
Stack: Java, Python, Hive, Hbase, Hadoop, Druid, Airflow

Feature enhancementsOpen source contributionsHadoop clustersDruidHBaseAirflow+2

Yahoo! inc.

Software Engineer

Jul 2011 – Feb 2018 · 6 yrs 7 mos · san francisco bay area

1. Yahoo Mail Backend
Worked on a new improved version of Download manager services for the Yahoo Mail web and mobile.
Made significant changes to the Save and Send services in Yahoo Mail
Worked on critical security issues in Yahoo Mail
2. YAM+ : Yahoo Ad manager
Worked on Yahoo scale data for creating user segments.
RTB, past-performance, optimization servers, ad servers.
3 Partner insights from Yahoo!, a Yahoo’s flagship search marketing analytics product.
Worked on BIG data from Yahoo’s search and advertisement platform.