Dec 2022 – May 2024 · 1 yr 5 mos · India · Hybrid

• Metadata lead
• ~A scala service storing metadata of projects,datasets,pipelines,functions,jobs etc dealing with big data jobs.
• ~Architecting features that will address customer requirements
• ~Developing a UI friendly git operations.
• ~ Dealing with customer escalations related to service
• Data quality
• ~Architecting a service that ensures data in a dataset adheres to certain rules
• ~Integration with a web based ide
• ~Running spark jobs in databricks on a schedule to ensure datasets are adhering to rules.
• Event result tracking to store history of datasets.
• Knowledge graph
• ~Collecting metadata related to pipeline,jobs etc developed by user and results of runs
• ~Generating relations among entities and results [job->job result, pipeline->job etc]
• ~Crawling customer data sources to provide data for predictive models to give out relevant dataset to use for pipeline.

Aug 2020 – Nov 2022 · 2 yrs 3 mos · Bengaluru, Karnataka, India

• 1. Designed and developed and led relay service. A service focussed on integrating with 3rd party transaction services.
• 2. Platform focussed development of mechanisms for fast integrations with various 3rd party security features.
• 3: Focus on reliability and performance through automated tests through unit tests, github pipeline,post deployment tests etc.
• 4: Docker container based service.
• 5.Part of privacydb team focussing on query execution.
• 6. Performance focussed engineering.
• 7: services were developed using golang from scratch.

Jan 2020 – Jul 2020 · 6 mos · Bengaluru, Karnataka

Dec 2018 – Jan 2020 · 1 yr 1 mo · Bengaluru, Karnataka

• Was part of storage team of Lenovo.
• ~Lenovo acquired 8kpc
• ~Responsible for porting 8kpc system to Lenovo code base
• ~Handled distribution of storage between active nodes for workloads coming from cloud

Sep 2010 – Dec 2018 · 8 yrs 3 mos · Bangalore

• Involved in Design and Development of 8KPC distributed filesystem core features and orchestration.
• Storage High availability for Virtual machines.
• Data Distribution architecture.
• Linux FS(8kpcFS dev).
• Orchestration of distributed system.
• Webservices security and performance.
• Applications based on SDS platforms.

Aug 2008 – Aug 2010 · 2 yrs · Bengaluru Area, India

• Was part of PSS development team. I was involved in massmailer and bugtracking tool development.