Jan 2022 – Oct 2023 · 1 yr 9 mos

• Collaborate closely with customers to understand their unique requirements and design innovative solutions that address their specific data migration needs, ensuring exceptional data quality and customer satisfaction.
• Lead the design and development of a highly efficient data migration and orchestration tool, working closely with cross-functional teams to ensure seamless data integration and transfer from various sources to cloud data warehouses.
• Devised and incorporated automated schema synchronisation mechanism in ingestion process to handle dynamic schemas of source tables/files.
• Act as a technical mentor, providing guidance and expertise to junior engineers, fostering a culture of learning and continuous improvement within the team.
• Leveraged expertise in Spark, Java, and data ingestion techniques to optimize performance and scalability of the ingestion tool.

Jun 2019 – Jan 2022 · 2 yrs 7 mos

• Developed automated tools for data ingestion from diverse sources, such as RDBMS, structured files, streaming platforms like Kafka and Confluent, and Facebook, into datalakes and cloud data warehouses, ensuring seamless integration and efficient data processing.
• Developed XML ingestion connector from scratch which can parse any level of nesting and circular dependencies in XML and ingest the data in tabular formats (row/columnar) in data lakes or data warehouses.
• Successfully drive the implementation of Change Data Capture (CDC) and Merge strategies, significantly reducing data setup time and costs for customers from 7 days to 3 hours.
• Utilized Spark and Java to create performant solutions, enhancing data processing capabilities.

May 2018 – Jul 2018 · 2 mos · Bengaluru Area, India

• Developed back-end for financial data analysis modules and diagnostics tools for signals using Slang.
• Worked on Asset Liability Management to learn in and out of ALM and different analysis tools.
• Used Stochastic Simulations for different scenarios to get funded status and different contributions over a time period. An appropriate strategy can be chosen using the results.
• Developed modules to get correlation and co-variance among different asset classes.

May 2017 – Jul 2017 · 2 mos · Kraków Area, Poland

• Analysed NuStar satellite data for variability, spectral variability of Blazar Mrk-421 using HEASoft and python.
• Analysed the spectra with different models available in xspec at Jagiellonian University, Krakow, Poland