Parth Shyara

Software Engineer

Bengaluru, Karnataka, India10 yrs 8 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in Apache Spark and data processing.
Proven track record in project management and system uptime.
Strong background in software design and development.

Stackforce AI infers this person is a Backend-heavy Fullstack Developer in the SaaS and E-commerce sectors.

Contact

Skills

Core Skills

Apache SparkSoftware DesignSoftware InfrastructureProject ManagementApache KafkaSoftware DevelopmentJob Scheduling

Other Skills

PythonPySparkAmazon Web Services (AWS)Google Cloud Platform (GCP)KubernetesTerraformGo (Programming Language)RedisDistributed SystemsJavaProtocol BuffersCore JavaNon-functional TestingC++CPP

About

Experienced Software Developer and a creative thinker adept in bringing forth expertise in design, installation, testing and maintenance of software systems. Able to effectively self-manage during independent projects, as well as collaborate as part of a productive team. Event Coordinator with a demonstrated history of working in the non-profit organization management industry with a Bachelor of Technology (B.Tech.) focused in Electronics Engineering from Indian Institute of Technology (Banaras Hindu University), Varanasi.

Experience

10 yrs 8 mos

Total Experience

2 yrs 9 mos

Average Tenure

4 yrs

Current Experience

Sundial

Senior Software Engineer

Jun 2022 – Present · 4 yrs · Bengaluru, Karnataka, India · On-site

Event Driven Orchestration **
Replaced a DAG based framework with in-house redis-streams based event system
Helped provide better parallelisation and control over the data transformations.
Easier to externalise to clients with added observaility and in-house state management
Spark Distributed Workloads **
Implemented a ETL layer from scratch to enable bespoke data transformations
Exposed to multiple types of connectors for spark, eg. bigquery, snowflake, etc
Migrated pandas to pyspark to support petabytes of data processing effectively
Actively owned multiple POCs regarding spark-on-kubernetes, livy-server
Metric Store **
Designed, implemented and migrated the metric store from blob storage to database
Supported write-once read-many usecase in most performant way
Optimised store configurations to support faster reads
DevOps **
Migrated a single instance API server to multi-region backend services
Automated CI based infra-deployments using terraform
Supported multi-cloud deployments for Spark workloads
Driven >50% improvements in CI times by optimising the workflows

PythonApache SparkPySparkAmazon Web Services (AWS)Google Cloud Platform (GCP)Kubernetes+6

Flipkart

2 roles

SDE 2

Promoted

Sep 2021 – May 2022 · 8 mos

Order Management System **
Worked on order creation, event generation with kafka and storage on hbase
Was responsible for maintaining 99.99\% system up-time
Reduced data footprint by ~50% and latency improved by ~25% on migration to the schema based order store. Developed indexing for this store and made it available to other teams within Flipkart
Post Order Workflows **
Worked with product and business teams to develop customer experience and cost optimisation features such as open box delivery and apply offers post order creation
Functioned with high level of technical complexity providing quick resolutions to stakeholders and minimize MTTD and MTTR metrics

JavaProject ManagementApache KafkaProtocol BuffersSoftware DesignDistributed Systems