Pratik K.

Senior Software Engineer

Berlin, Berlin, Germany7 yrs 5 mos experience

Highly Stable

Key Highlights

Expert in real-time data processing and optimization.
Proven track record in designing scalable systems.
Strong background in Big Data technologies and frameworks.

Stackforce AI infers this person is a Backend-heavy Fullstack developer in the SaaS industry.

Contact

Skills

Core Skills

Big Data ProcessingGoogle Cloud PlatformReal-time ProcessingMachine LearningRest

Other Skills

Data StructuresLinuxScalaApache BeamDataflowArchitecture designLambda architectureA/B testingScalabilityJavaAlgorithmsSQL

About

My experience as a developer has taught me a lot, ranging from engineering skills to managing project stakeholders. I have worked on multiple projects which included REST services, real-time processing pipelines, multiple databases(SQL and NoSQL). These projects included designing(sometime re-designing), implementing and scaling these systems for better user experience and instantaneous state change propagation across systems. I also have an inclination to learn tech advancements, new algorithms(sometimes new usage of old ones) and fix anything that looks broken(only limited to computer systems)

Experience

Twitter

Senior Software Developer

Jan 2021 – Jan 2023 · 2 yrs

Lead the effort(from project inception till delivery)on projects to create a automated validation framework to validate datasets being migrated to reduce manual effort by developers by leveraging Apache Beam/Dataflow, reducing cost incurred(by 10 - 15%) by real time engagement aggregation system(handling millions of events per second) via optimizations like compression, using low cost resources and experimenting with new GCP offerings
Lead the effort to solve the know-your-customer problem of Core Data and Metrics datasets by developing a framework which leverages the audit logs to generate insights like top users, week on week change in dataset size and common access patterns of data being used(sql query parsing) on Google BI tool Looker
Designed(High level as well as low level architecture) of new user engagement processing system with for customers accessing engagements data(with near real time SLA)
Worked on optimizing jobs for processing all of tweets data(20% reduction in job run time)
Familiar Technologies: Scala, Big Data processing(Scalding, Apache Beam, Dataflow), Google Cloud Platform(BigQuery, Dataflow, BigTable, Pubsub)

Data StructuresLinuxScalaBig Data processingGoogle Cloud Platform

Flipkart

3 roles

Sde 3

Aug 2020 – Nov 2022 · 2 yrs 3 mos

Worked on Minimum Guarantee View(MGV) : Ensuring the goals of business teams are met with a minimum guarantee

Sde 2

Promoted

Jan 2017 – Aug 2020 · 3 yrs 7 mos

Worked on data propagation pipeline with multiple sources providing state for attached attributes(also helped reduce SLA from 15min to few seconds, realtime budget capping systems for advertisements(lambda architecture) and helped it scale through technical changes
Helped scaled serving systems for high traffic events(sale days).
Designed and implemented Grid Search framework to allow training of multiple instances of ML model in parallel to choose best fit / run A/B experiments
Helped develop real time event tracking system for user interactions and get real time views of the data per user based on pluggable custom code
Lead the effort on identifying the feasibility of Elastic Search for solving filtering and custom ranking (powered via ML) for merchandising content on Flipkart Homepage
Designed and implemented sub-system with single source(Kafka) and multi-sink architecture(aerospike, solr) with High Availability requirements
Optimised user-path serving system to reduce memory usage by 50% and improve tail latency
Familiar Technologies: Java(dropwizard for REST, RMI and many more), NoSql Databases(Aerospike, redis), In-memory data stores(hazelcast), real-time processing framework(Apache Storm), messaging queue(Apache Kafka), reverse indexing framework(Elastic Search), co-ordination service(Zookeeper)

Sde1

Jul 2015 – Dec 2016 · 1 yr 5 mos

Worked on REST services in order to develop serving platform to serve Ads on internal as well as external supply(DSP platforms)
Identified bottlenecks and helped make serving systems horizontally scalable