Aug 2018 – Nov 2020 · 2 yrs 3 mos · Bengaluru, Karnataka, India

• Working as a backend developer in the cluster management application layer that handles the interactions between the big data engines on data processing clusters of virtual machines and the Cloud(AWS, Azure, GCP).
• Added support for newly introduced instance types which provide higher computing power enabling the customers to run their big data jobs faster across all the clouds AWS,GCP,Azure and Oracle
• Created an interface to interact with the cluster master when ssh is disabled to ensure more security to the customers using Jeeves API's
• Contributed to Qubole python SDK to enable customers to programmatically create, edit clusters
• Spearheaded developing and maintaining ACM Monitoring and Alerting Infrastructure completely as part of the product stability drive which helped pro-actively identify the cloud issues as well as product bugs ahead of customers reporting them.
• Worked on a fix for Hadoop upscaling which incurred huge cost to customers due to a bug where we upscale with the instance type which could not meet the MapReduce memory requirement.
• Worked closely with the middleware teams to address multiple enhancements.
• Automated the new instance addition for AWS cloud
• Took part in code and design reviews to ensure code quality across the organization.
• Have written automated and unit test cases in python to help the QA team test the changes quick and reduce the QA effort

Aug 2016 – Aug 2018 · 2 yrs · Bengaluru, Karnataka, India

• Tools and Technologies used:
• Python, MySQL, Hive, Hadoop 1, Hadoop 2, Spark, Presto, SQOOP, AWS Cluster Management and Configuration, Azure, Unix
• Orchestrated cloud resources and backend data processing components like Hive, Hadoop 1/2, Spark, Presto etc. for large-scale data processing applications
• Identified, designed and implemented complex enterprise and web-centric solutions to solve the technical customer issues
• Designed, debugged and fine-tuned large-scale data workloads of the customers based on its business requirements
• Optimized and solved the customer problems while building and running their ETL pipelines using MapReduce/Spark frameworks as well as analytical queries in MySQL, Spark Sql, Hive etc.
• Provided workarounds/resolutions to the customer issues across the technology stack including data queries in Hive, Hadoop/Spark jobs, fine-tuning data processing applications
• Debugged any kinds of Security/VPC issues through Amazon Web Services (AWS) cluster management and configuration
• Administered and monitored the memory tuning for different java processes involving daemons like ResourceManager, NodeManager, NameNode, DataNode, ApplicationMaster etc.
• Debugging and Identifying the platform related issues and providing immediate and feasible workarounds to the customers to unblock their workloads.
• Helping and providing solutions to the customers to achieve their Use-cases with the big data technologies.
• Good management and communication skills, able to work well in a team as well as independently.
• Self-motivated and hardworking.
• Quick learner and passionate to learn and explore new technologies.

Jul 2014 – Jul 2015 · 1 yr · Bangalore

• Worked as part of AGILE Model of Software Development.
• Gathering the requirements from the user on daily basis and develop the documents to meet the deadlines.
• Assisted in bringing in Linux Control Applications.
• Assisted in Supporting and Updating Unix Control Programs.
• Assisted in answering Emergency Application Control calls.
• To perform required enhancements to the existing code whenever requested by the user.
• To Test the documents manually as well as using an automated tool developed on XIETS environment by designing appropriate Test Cases.
• Technologies: Unix Shell Scripting, XML/XPATH/XSLT,XQuery
• Tools: Requirements Editor run on Citrix machine, XIETS, Manual Testing.