Karan Singla

Product Manager

Vancouver, British Columbia, Canada8 yrs 6 mos experience
AI EnabledAI ML Practitioner

Key Highlights

  • Nearly 7 years of experience in data engineering and analysis.
  • Expert in building scalable data pipelines and ETL processes.
  • Proficient in Power BI and Azure technologies.
Stackforce AI infers this person is a Data Engineering and Business Intelligence expert in the SaaS industry.

Contact

Skills

Core Skills

Data AnalysisData EngineeringBusiness Intelligence

Other Skills

Attention to DetailAzure Blob StorageAzure Cosmos DBAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevOps ServerAzure FunctionsAzure SQL DatabaseBusiness ApplicationsBusiness Data ManagementBusiness Intelligence ToolsCommunicationDAXDB2

About

• Nearly 7 years of professional experience in statistical analysis, data modeling, data engineering solutions • Data Engineer with robust knowledge and experience in Data Analysis, Data Mining, Data Cleaning, Data Visualization, and building data pipelines • Creative in finding solutions to problems and determining modifications for optimal use of organizational data, using Machine Learning, Deep Learning, and BI tools like Power BI. • Data Engineer with almost 2 years of experience, building ETL process from scratch, using several frameworks and platforms, with a deep knowledge of databases, transforming business needs into data modeling • Experienced in performing ETL on data on various client files and doing data cleansing and analyzing and aggregating for preparing Data Standardization Document (DSD) and Data Quality Report (DQR) to feed data correctly into the products • Data Engineer with demonstrated ability in designing and building scalable Data Pipelines with proficient knowledge in R and Python programming, Hadoop Ecosystem, Exploratory Data Analysis, Structured Machine Learning algorithms, and Power BI Visualization • Superior skills in Advanced Excel on conditional formatting, count, data validation, index, match, sum, pivot table, VLOOKUP, and data table • Proficient knowledge of statistics, mathematics, and analytics with an excellent understanding of business operations for effective analysis of data • Experienced in migrating data and databases from on-prem infrastructure to the Azure data lake. Raw data is transferred to Azure Storage and processed by Azure functions and then stored in Cosmos DB • Experienced in Ingestion of Large Datasets using Python, writing Python codes to automate the interaction, and downloading of data as per the data frequency from RESTful API, Azure Storage, FTP servers, or any client-side application which acts as a data source • Skilled in setting up Data Lake in Azure and setup Kafka messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on Oracle DB • Skilled in design and development of various dashboards, reports utilizing Tableau and Power BI Visualizations like bar graphs, scatter plots, pie-charts, geographic visualization, and other making use of actions, other local and global filters according to the end-user requirement • Experienced in developing, maintaining, and processing large databases with complex relationships between tables. Written several advanced SQL queries for extracting relevant data for predictive analytics

Experience

8 yrs 6 mos
Total Experience
1 yr 9 mos
Average Tenure
9 mos
Current Experience

Fresche solutions

Senior Power BI Developer

Sep 2025Present · 9 mos · Canada

Silvercreek

2 roles

Senior Data Analyst

Jan 2025Aug 2025 · 7 mos · Vancouver, British Columbia, Canada

Data Analyst

Sep 2022Jan 2025 · 2 yrs 4 mos · Vancouver, British Columbia, Canada

  • Designed comprehensive data model to integrate data from various sources and facilitate analysis. Used Azure Data Factory for ETL processes, Azure SQL Database for structured data storage, and Azure Blob Storage for unstructured data. I also implemented data management and governance practices using Azure Data Catalog and Azure Policy.
  • Solely developed and designed custom user-friendly application using PowerApps to streamline data input and workflow management for different departments and for business automation, presenting them to higher authorities and showcasing them to managers who would be using them. Incorporating best practices for usability and accessibility.
  • Creating New ETL pipeline for Dynamics CRM (on-premises) migration to Dynamics 365 migration (On-Cloud)
  • Designed and developed tabular data models in SSAS to satisfy business requirements and data analysis.
  • Designed and developed Data Flows and improved overall data model.
  • Leveraged PowerApps to automate complex business processes, reducing manual labor, improving data accuracy and reporting through SQL Server and PowerBi.
  • Developed deep-linking and variable dependencies between different databases in the same PowerApp to ensure seamless data integration.
  • Created custom formulas in PowerApps to manipulate and analyze data, improving the depth and accuracy of business insights.
  • Trained team members on PowerApps development, empowering them to leverage the technology for their own projects.
  • Created interactive Power BI Dashboards, KPIs, and Reports for Monthly Metric analysis to replace traditional excel reporting and automate data refresh using Power BI On-Prem Gateways
  • Migrating PowerBi Reports to SSAS Tabular data models and reduced storage usage by 90%.
  • Executed new scorecard feature to old PowerBi reports
  • Utilizing SQL Server, Microsoft Power BI, Microsoft Power Apps, SSIS, SSAS, Visual Studio for data intelligence and analysis
DAXCommunicationSharePointSnowflake CloudMicrosoft AzureDashboards+7

Karbon

Business Intelligence Developer

Apr 2024Jun 2024 · 2 mos

  • Automated data refresh schedules in Power BI Service, ensuring up-to-date reports and dashboards, which significantly reduced manual updating processes and improved data accuracy.
  • Developed Power BI development lifecycle within an aggressive 8-10 day timeframe, leveraging DAX formulas and M queries for optimized data modeling.
  • Led the design and implementation of Row-Level Security (RLS) in Power BI, ensuring data confidentiality by validating user access through Tenant Permakey-Account ID correlations, enhancing data security and compliance.
  • Developed dynamic, user-friendly Power BI slicers with advanced functionalities such as multi-select without CTRL, search fields, and the inclusion of all potential values, significantly improving report interactivity and user experience.
  • Utilized Power BI Desktop to refine and enhance the Karbon data model, ensuring seamless integration with Snowflake via DirectQuery for real-time analytics.
  • Used Power Query within Power BI Desktop and Power Bi Data Flows for data cleaning and transformation, ensuring data integrity and accuracy.
  • Optimized Power BI reports by segregating measures into a dedicated _measures table, streamlining report performance and maintenance while ensuring inclusion of only essential metrics, significantly improving report efficiency and clarity.
DAXCommunicationDashboardsSQL Server Reporting Services (SSRS)Data AnalyticsData Quality+5

North west redwater partnership

Data Analyst and Engineer

Mar 2024May 2024 · 2 mos · Edmonton, Alberta, Canada

  • Migrating AX 2012 R2 to Dynamics 365 for Finance and Operations (D365FO).
  • 2-way integration b/w Dynamics 365 & IBM Maximo using SQL Stored Procedures
DAXCommunicationDashboardsSQL Server Reporting Services (SSRS)Data AnalyticsData Quality+5

Government of alberta

Data Analyst

Jul 2023Jul 2025 · 2 yrs · Alberta, Canada

  • Led the transition from manual data pipelines using daily-run PowerShell and Python scripts to Power Query transformations. Enabled consistent and automatic data refreshments, reducing manual intervention, and ensuring timely data availability for analytics and reporting.
  • Automated data extraction from different data sources to Power Bi Dataflows.
  • Developed and implemented intricate Data Flows in Power BI service required for the multiple different Dashboards, enhancing the efficiency and accuracy of data visualization.
  • Expertly managed large datasets, ensuring smooth integration and transformation, while rectifying various data discrepancies.
  • Implemented data gateways to connect Power BI Service with on-premises, ensuring seamless data refresh and integration for up-to-date analytics.
  • Constructed and maintained a full-fledged data platform on Azure Data Factory and Data Bricks to handle data to ingest, store, process, and analyze throughout. Worked with both structured and unstructured data for processing and storing data.
  • Developed and managed stored procedures to encapsulate frequently used or complex SQL statements, improving database performance and maintainability.
DAXCommunicationSharePointSnowflake CloudDashboardsSQL Server Reporting Services (SSRS)+6

The rmc group of companies

Data Analyst

Apr 2023Aug 2023 · 4 mos · Alberta, Canada

  • Created interactive Power BI Dashboards, KPIs, and Reports for Monthly Metric analysis to replace traditional excel reporting and automate data refresh using Power BI On-Prem Gateways
  • New development and on going support of the existing data lake and reporting environment.
DAXCommunicationSharePointDashboardsSQL Server Reporting Services (SSRS)Data Analytics+6

Legal aid alberta

Business Intelligence Developer

Sep 2022Jun 2023 · 9 mos · Alberta, Canada

  • Developed and maintained SSIS packages to extract, transform, and load (ETL) data from various sources into SQL Server databases.
  • Designed and optimized complex T-SQL queries, ensuring efficient data retrieval and improving system performance by over 20%
  • Leveraged T-SQL to perform ETL operations, transforming and loading over 1TB of data into the SQL Server Data Warehouse.
  • Automated daily ETL workflows by scheduling SSIS packages using SQL Server Agent, ensuring timely data updates.
  • Designed and implemented SQL Server database schemas, tables, views, and indexes, ensuring data integrity and optimizing performance.
  • Worked closely with development teams to understand and translate business requirements into efficient database solutions.
  • Leveraged PowerApps to automate complex business processes, reducing manual labor, improving data accuracy and reporting through SQL Server and Power BI.
  • Developed deep linking and variable dependencies between different databases in the same PowerApp to ensure seamless data integration.
  • Created interactive Power BI Dashboards, KPIs, and Reports for Monthly Metric analysis to replace traditional excel reporting and automate data refresh using Power BI On-Prem Gateways
  • Migrating Power BI Reports to Tabular data models and reduced storage usage by 90%.
  • Utilizing SQL Server, Microsoft Power BI, Microsoft Power Apps, SSIS, SSAS, Visual Studio for data intelligence and analysis
  • Collaborated in an agile development environment, working closely with cross-functional teams through sprint planning, daily stand-ups, and retrospective meetings, ensuring efficient and iterative development progress.
  • Automating various manual inputs across different departments by creating new Power apps.
  • Creating New ETL pipeline for Dynamics CRM (on-premises) migration to Dynamics 365 migration (On-Cloud)
  • Designed and developed tabular data models in SSAS to satisfy business requirements and data analysis.
DAXCommunicationSharePointDashboardsSQL Server Reporting Services (SSRS)Data Analytics+6

Neobi technology

Data Engineer

Jan 2022Mar 2022 · 2 mos

  • Ensured the transformation and organization of data while maintaining the quality of client databases
  • Executed new ETL pipeline from scratch by using Azure Data Factory, Azure Data Bricks, SharePoint, Azure Azure SQL Database and Azure Data lake.
  • Worked directly with the CTO & Quality Assurance Team while helping to advance the protocols of the ETL
  • Collected, cleansed, and provided modeling and analysis of data for structured and unstructured data used for various business initiatives
  • Created impactful dashboards n Excel and Tableau for data reporting, extracting, interpreting, and analyzing the data to identify key metrics and transform data into meaningful, actionable information
  • Managed 100%of the lifecycle of architecture used to analyze and process the data following SOPs, TTPs, and other templates
  • Ingested data from different sources using SQL and Analytics API to construct data views for Tableau
  • Created data extraction, cleansing, and load programs to move data from source systems to various Data warehouses
  • Processed, manipulated, stored, and parsed data into multiple data pipelines
  • Developed, monitoring and alerting capabilities to ensure 100%of data pipelines are working
  • Worked to constantly improve the efficiencies of the platform while advising on new ways to get more accurate, real-time data delivered in streams and pipelines to various applications
  • Managed tasks through Trello and ensure validations are submitted and client dashboards are refreshed daily
  • Developed & maintained functions, PowerBI, Azure, and other technologies in the stack
CommunicationData Warehousing

Collegedesk

2 roles

Data Analyst

Promoted

Aug 2018Oct 2019 · 1 yr 2 mos · New Delhi, Delhi, India

  • Designed, built, and managed Real-time 'Credit Products Recommender system'. Integrating data from Credit Reporting API, ingesting through HDInsight, evaluating JSON, extracting credit score detailed attributes, and storing in Azure Data lake. Designed automated marketing to subscribers and ingested new subscriptions back to the Azure SQL database. Created a build status notifier for the entire process to manage the pipeline
  • Used Databricks for extracting and wrangling large datasets to prepare the desired dataset
  • Built a Long Short-Term Memory (LSTM) neural network model-based query routing system
  • Used Machine Learning technique (Natural Language Processing) and Deep Learning Technique (LSTM) for text processing and categorizing the queries from customer requests and allocating them to the respective departments such as Credit, Debt, Loan, Mortgage, and General Queries
  • Achieved an accuracy of 80% in detecting the intent of the query and routing them to its respective department
  • Built a classification model using Convolution Neural Networks (CNNs) to analyze if the patient has a tumor and predict it at early stages using a machine learning model.
  • Designed and implemented process enhancements by automating error handling techniques to increase the efficiency of data loads and reduce task failures by 20%
  • Automated huge volumetric quarterly actuarial data loads using SSIS packages and PLSQL packages to reduce manual effort by 70% and reduced PD by 25%
  • Conducted Exploratory Data Analysis using "Individual mortgage Data Set" to study the pattern of different mortgage payments vs payment times. Worked on data preparation for "Individual mortgage Data Set" to identify variables, meet data governance and quality requirements, transform, and build training and test sets to be used for analysis
  • Created DDL, DML, DCL scripts, functions, stored procedures, and packages in PLSQL and MS-SQL

Junior Full Stack Developer

Dec 2014Aug 2018 · 3 yrs 8 mos · New Delhi, Delhi, India

  • Worked on a project with hands-on experience in monitoring air pollution using drone-based technology.
  • Collected air quality data samples and identified patterns to take necessary measures and build an effective broker solution.
  • Processed Data and proposed solutions to improve system efficiencies and methods.
  • Executed Multiple Data analysis projects using Excel and Python to gather actionable insights by predicting and modeling future outcomes.
  • Utilized MS SQL, Tableau, and Microsoft Power BI for data intelligence and analysis.
  • Utilized statistical techniques for hypothesis testing to validate data and interpretations.
  • Presented data to draw business insights for managerial action and strategy.
  • Used statistical techniques for hypothesis testing to validate data and interpretations.
Communication

Education

British Columbia Institute of Technology

Dec 2020Jul 2021

Hindu College, University of Delhi

BA (Hons) — Economics

Jan 2012Jan 2015

Stackforce found 100+ more professionals with Data Analysis & Data Engineering

Explore similar profiles based on matching skills and experience