Apr 2017 – Nov 2019 · 2 yrs 7 mos · Hyderabad, Telangana, India

• Working at world's top most valuable organisation on developing end to end high speed real time data analytics solution using Kafka, Ignite, Spark Streaming, Scala and Tableau with programming in Scala and Python.

Aug 2015 – Apr 2017 · 1 yr 8 mos

• Developed complex transformations using Apache Spark and store the data to HBase and Hive tables
• Maintain latest customer and account information along with history in HBase tables for downstream systems
• Worked with Hortonworks engineering team to identify the root cause of few issues in Hadoop Systems and developed workaround solutions for the new bugs found
• Analyze different file formats and compression techniques available to identify the suitable one for different use cases
• Performance tuning at individual jobs as well as at project level which made a significant impact on execution time
• Unix Shell scripts and Oozie workflows for automated batch jobs execution
• Hive CLI to beeline migration
• Create xmls out of data in hive tables as feed to few downstream systems such as Unified Case Management system using Apache Spark
• Debugging Application logs, Hive Server logs and HDFS audit logs for analysis on issues
• Worked with security systems such as Ranger, KMS with Kerberos authentication and encrypted databases

Jun 2014 – Aug 2015 · 1 yr 2 mos

• Performed complex transformations using Hive on Tez
• Worked on updates in Hive when the inbuilt functionality was not available
• Performance tuning at individual jobs as well as at project level
• Analyze different file formats and compression techniques available to identify the suitable one for different use cases
• Unix Shell scripts for automated batch jobs execution via Control-M
• Debugging Application logs, Hive Server logs and HDFS audit logs for analysis on issues.
• Worked with security systems such as Ranger, KMS with Kerberos authentication and encrypted databases.
• Sqoop jobs for data ingestion from RDBMS systems.
• Developed UDF's in Hive

Dec 2012 – Jun 2014 · 1 yr 6 mos

• Worked in both application development and building test automation framework. Worked with Microsoft FTE's for understanding and developing functional design
• Designed and developed agreement service using Rest API which is used to search for agreements in VLCM for MSLicense.
• Developed stored procedures to process and filter the agreements for different kinds of input search.
• Created a tool to test the service with a user interface to provide inputs and verify the xml outputs covering all the functional scenarios
• Responsible for performance optimization of Agreement Service
• Responsible for requirement analysis, developing stored procedures, unit testing. Involved in Test data preparation - Created SSIS packages in Microsoft Business Intelligence Tool
• Involved in automated test case execution - Filed bugs. Worked on bug fixes, Bug fix validation, Published Reports and status
• Worked on creating automated test cases on Microsoft Glider Framework for regression testing.

Apr 2011 – Nov 2012 · 1 yr 7 mos

• SDET Role - Worked in both application development and testing. Involved in developing database scripts and production bug fixes. Responsible for Requirement Analysis, Developing database scripts, Unit testing, Test Case Design, Test Case Preparation and execution
• Database testing - Developing database scripts for requirement analysis as most of the requirement content is received from Microsoft Database
• Involved in Test case execution - Filed bugs; Worked on bug fixes; Bug fix validation; Published Reports and status
• Designed and implemented all the business rules and functional validations during automated test case execution which takes the real time data from database to validate the price data in quotation
• Worked on creating automated test cases on Microsoft Glider Framework, CodedUI and executing automated test cases
• Performed BVT, Buddy Testing, functional testing, Regression Testing and performance testing
• Worked on Windows Azure Migration project for MLA, LW, PUR and SPUR applications