Aug 2021 – Jun 2025 · 3 yrs 10 mos · Hyderabad, Telangana, India · Hybrid

• Responsible for architectural Designing and Building product from the scratch.
• Designing and building Conceptual, logical and Physical data models which follows Fact Constellation (Galaxy schema).
• As part of Data Engineering, Orchestrating End to End pipelines for data movement using Azure Synapse Analytics and Databricks with programming languages like Python, PySpark, SparkSQL and Cypher.
• Fetching the data from disparate data sources whether its SQL or NoSQL data like MongoDB Collections, Neo4j, CSV, Parquet, EDW and performing sanity checks on them and performing data wrangling operations.
• Following the Medallion Lakehouse Architecture in the project where we are maintaining separate layers for Bronze, Silver and Gold.
• Creating External tables on top of the files in ADLS by leveraging the Polybase functionality.
• Loading data into Delta Lake tables and Azure Datawarehouse (Dedicated SQL Pool) and writing the aggregated data back to Neo4j.
• Transferring the data to clients in JSON, CSV and Parquet format.
• Automating the process using ADF or Azure Synapse Pipelines and creating Triggers (with multiple types like Tumbling Window, Schedule).
• Helping Power BI developers in building Analytical Dashboards and providing DAX queries for KPIs as wells as other numerous types of graphs and charts.
• Debugging, troubleshooting and optimizing the performance of the notebooks and pipelines.
• Building Data Warehouse for Analytical processing.

Aug 2019 – Aug 2021 · 2 yrs

• Orchestrating Data pipelines using Azure Data Factory to load data from different file formats to Relational stores.
• Performed basic sanity checks on data using PySpark, SparkSQL and Azure Databricks.
• Integrated historic SSIS Package into Azure Data Factory.
• Using Azure Databricks for advanced level of transformations, Data Cleansing and integrating Databrick notebooks with Azure Data Factory.
• Automation of existing manual process using Control-M, PowerShell, SQL Server Agent.

Dec 2017 – Aug 2019 · 1 yr 8 mos

• Data warehousing and analysis for Major Retailers of North America.

Mar 2017 – Dec 2017 · 9 mos · Hyderabad, Telangana, India · On-site

• Data Warehousing and Analysis in Retail and Marketing Domain.
• Building Data Pipelines and Data Models for extracting and ingesting the data to the database using SSIS Packages and transformation of the data based on our requirement and loading it to the database.
• Scheduling jobs which consist of SQL Scripts as well as SSIS packages using SQL Server Agent.
• Creating stored procedures/views, SSIS Packages, SSRS reports and modifying them based on the requests.
• Maintaining the versions of script and SSIS Packages using TFS.

Aug 2016 – Feb 2017 · 6 mos · Hyderabad Area, India · On-site

• Database Management and Warehousing for Financial and Mutual Funds Companies
• Coordinating with the front end/website developers as well as business analysts to understand the requirement and providing solutions to support them.
• Creating procedures, views, tables and functions based on requirement of the application/developers.
• Modifying existing stored procedures, views and functions if any changes required for application as well as performance optimization point of view.
• Knowledge of Parsing XML data for storing into relational database.

Aug 2013 – Aug 2016 · 3 yrs · Hyderabad Area, India

• Completely engrossed in Database Management, Analytics, Payment Integrity in US Healthcare.
• Creating stored procedure and tables, generating reports, performance optimization of query, implementation of the logics to fetch desired result, performing unit testing on the result set.
• Export and import of data using SSIS and scheduling jobs, performance tuning, creating User Defined Functions using TSQL.
• Creating procedures, views, functions for auditing as part of payment integrity solutions.