Sep 2024 – Present · 1 yr 9 mos · Greater Sudbury, Ontario, Canada · Remote

• 1) Performing DB promotions for stored procedures.
• 2) Conducting periodic backups of production databases.
• 3) Developing and testing REST APIs.
• 4) Fixing reporting issues that arises in production.
• 5) Enhancing reporting procedures for the proper functioning of in-app reports of Sofvie product.
• 6) Developing new reports depending on the use case.

Feb 2024 – Aug 2024 · 6 mos · Greater Sudbury, Ontario, Canada · Remote

• Worked on:
• 1) Creating stored procedures for reporting purposes.
• 2) Collaborating with senior database administrators for incremental DB releases of the product.
• 3) Researching and optimizing the query performance by creating Indexes tailored specifically for the datatypes.
• 4) Understanding the Sofvie product db schema and maintaining it.
• 5) Automating the database tasks for streamlining data into the system.
• 6) Developing Client APIs for the customer data.

Jan 2024 – Apr 2024 · 3 mos · Lethbridge, Alberta, Canada

• Worked on a MITACS Data management project to develop comprehensive data management solutions.

May 2023 – Aug 2023 · 3 mos · Lethbridge, Alberta, Canada

• Worked on a Facilities department project to automate data ingestion and transformation process.
• Work items:
• a) Developed Data Architecture and Data ingestion pipeline in Airflow to ingest data from source to SQLServer.
• b) Created DBT scripts to transform data.
• c) Standardized ingested data using SQL Server stored procedures.
• d) Developed documentation for the models created and written custom tests for data models developed.
• e) Created custom docker image specifically for this deployment.
• f) Orchestrated entire workflow using Airflow.
• g) Trained the business stakeholders regarding the usage of the following components.
• h) Created user and process documentation for business stakeholders.
• i) Successfully deployed and verified the scripts onto, the QA and Prod server.
• j) Reduced the manual effort from 2-3 days to less than 10 minutes to complete the workflow.

Jan 2023 – Apr 2024 · 1 yr 3 mos · Lethbridge, Alberta, Canada

• Worked as a proctor at University Testing Centre

Sep 2022 – Apr 2024 · 1 yr 7 mos · Lethbridge, Alberta, Canada

• Fall 2022:
• CPSC 3780 - Computer networks
• I undertook Computer networks laboratory as TA (Teaching Assistant) assisting Dr.Robert benkoczi.
• Which also includes helping students in CPSC 1620 - fundamentals of programming.
• Spring 2023:
• CPSC 3720 - Introduction to Software Engineering
• Assisting Dr. Anvik in marking the assignments and resolving group issues.
• Fall 2023:
• Marking CPSC 3660 Introduction to Database Management Systems
• Coordinator of JJWS Research Lab
• Spring 2024
• CPSC 3770 - Human computer Interaction
• CPSC 1770 - Intro to probability and statistics by Jana Archibald

Mar 2023 – Feb 2024 · 11 mos · Toronto, Ontario, Canada · Remote

• Worked on developing end to end data products and data governance using open source data stack.
• Skills:
• Snowflake CDW , AWS S3, Gitlab, Postgres DB, Oracle DB, Airbyte, DBT, Airflow, Openmetadata, AWS SNS, Docker, Python, Prefect
• Tasks accomplished:
• a) Written custom DBT scripts to transform source data.
• b) Created Airbyte pipeline manually and orchestrated programmatically through Airflow.
• c) Administered Docker containers and their deployment.
• d) Performed health checks of containers and restarted them, when downtime has encountered.
• e) Orchestrated the entire process of ingestion to file writing.
• f) Written data quality tests that meet the destination system requirements.
• g) Integrated data governance platform into the stack and tested various databases functionality in metadata ingestion platform.
• h) Created proof of concepts for clients to perform masking of data.
• i) Contributed to Openmetadata documentation.
• j) Implemented multiple POCs using Open metadata and tested various functionalities of database connectors.
• k) Researched and explored the possibilities of creating custom connector.
• L) Implemented a CDC-based POC using AIrbyte with source as (Postgres, Mysql) database.

Jun 2021 – Aug 2022 · 1 yr 2 mos · Hyderabad, Telangana, India

• My core optimizations:
• > (Iteration 0) --> (5:30 hrs / 6:30hrs)
• > (Iteration 1) --> (3:00 hrs - 3: 30 hrs) (50% Time Reduction)
• > (Iteration 2 ) --> (1:30 hrs - 2:30 hrs) (22 % Time Reduction) (Parallel Process).
• Tasks accomplished:
• A) Handled one entire subject area of Insurance domain, and developed the fact table Job (Inc and historic) for the above subject area, which is currently running in production.
• B) Fixed the automation-related bugs on the fly, after deployment to higher environments.
• C) Optimized the data pipeline run time of a subject area from (5.30 hrs- 6 hrs) to (3 hrs- 3.30 hrs) which reduced the time by 40-50%.
• D) Generated data pipeline dash boards in Snowflake using Snowsight for daily job runs, which vividly, explains the total time taken by the last 10 days, total memory captured daily (Onprem to Snowflake), and also several different KPI's. (Production, QA reports), that enhances the developer productivity, for monitoring job workflows.
• E) Found max threshold query limit per DML statement in Snowflake, and has written a Python script to generate minimal delete statements to perform the operation.
• F) Compared 2 methodologies (Softdeletes vs Harddeletes) and concluded which works better from a cost and time standpoint.
• G) Integrated data from SQL Server into Snowflake, and built data lake.
• (Historic + Incremental)
• H) Implemented the parallel execution of jobs, in Matillion.
• (Currently, this is in production and is running around (1 hr: 30 m - 2 hr.30 m), which was running 5-6 hrs previously.)
• I) By the above solution, the client credit consumption on Snowflake has almost reduced to 60% which saves around (5K - 6K) $ every month.
• J) Fixed Matillion notification issue of which source system has failed in a neat and consolidated manner. Also written a javascript procedure to delete the unwanted rows to sync up both production and QA data.
• L) Handled transformation of data from source systems using python.

Dec 2020 – Jun 2021 · 6 mos · Hyderabad, Telangana, India

• Tools I daily use :
• Snowflake Cloud Data Platform, AWS, Python, Pandas,
• Snowflake Stored Procedures, AWS Glue Crawler, AWS S3, Matillion ETL.
• Accomplishments:
• 1) Worked on Datamodelling. (conceptual, physical).
• 2) Generated entire project ER model, using Opensource tools.
• 3) Transferred more than a billion records from On-prem to the Snowflake cloud in QA env.
• 4) Successfully designed and implemented historic SCD2 audit related packages in Matillion.
• 5) Automated most of things using Python.
• 6) Learnt robust data testing strategies, that result in the highest data quality.
• 7) Written automation testing scripts to validate, and generate the source DDLs from excel sheet.
• 8) Successfully executed incremental, historic jobs as a complete workflow in Matillion
• which loads the data from { Onprem ---> AWS S3 (Datalake) ---> Snowflake landing layer----> Snowflake Curated layer }.
• 9) Troubleshot and found critical, bottleneck performance issues in Matillion, while performing huge data loads.
• 10) Also assisted QA team in writing python automation scripts to validate the source and destination counts, by date, by number of records, by duplicate count checking.
• 11) Implemented memory capturing script which captures source system data transferred daily from Oracle to Snowflake, which illustrates how much data is loaded every day. (Incremental and Full Load).
• 12) Worked on stream lining the business LOB, Job flow, which eradicates manual tweaking of Jobs.
• 13) Performed my level of EDA (Exploratory Data Analysis) to understand the business problem.
• 14) Automated hard deletes component, according to the LOB(Line of Business).
• 15) Also modified the default value capturing job, to output specific LOB tables, default values.
• (i.e added a new column to the CDC table).
• 16) Also found, many implicit data conversion issues in Matillion and has provided fix.

Dec 2019 – Mar 2020 · 3 mos · Chennai Area, India

• Worked as a Problem Setter intern for GUVI-CODING platform, and also worked on flask framework., to create a full-stack app. Got a clear theoretical perspective about microservices and also learned about the scaling of apps. and mentored Zen class students.
• Worked on :
• 1) Creating a Full Stack application using Flask.
• 2) Implemented Cache server to reduce the response time of the application.
• 3) Created coding problems for the platform.
• 4) Written the entire backend and frontend, of the web application.
• 5) Apart from work, mentored students on logic building, and problem-solving using python.
• 6) Taught theoretical System design, OS, DBMS, Networking and cryptography lectures to the Zen class students.
• Tech Stack Used:
• Python, Flask, HTML, CSS, Webscraping, Redis, MongoDB etc
• Accomplishments:
• Offered a Highest PPO for the work delivered in GUVI.

May 2018 – Aug 2018 · 3 mos · Greater Hyderabad Area

• Roles and Responsibilities:
• 1: Inculcating Research based education in children, from an early age.
• 2: Make children, Question everything rather than accepting the things the way they are.
• Personal Development:
• 1: Learnt team building skills.
• 2: Became team leader for a group of 5 people.

Feb 2018 – May 2018 · 3 mos · Hyderabad, Telangana, India · On-site

• Worked under professor Dr.Ravi Shankar Nanduri in the examination branch to update the students results data which was Provided by J N T U H.
• Roles and Responsibilities:
• 1: Successfully written a PL/SQL procedure to transform the results of the JNTUH Students.
• 2: Post transformation the data is delivered to the examination branch for report generation.