M

Mayday C

Software Engineer

Houston, Texas, United States3 yrs 3 mos experience
AI EnabledHighly Stable

Key Highlights

  • Expert in ETL development using multiple tools.
  • Strong experience in Data Warehousing and Data Engineering.
  • Proficient in designing complex data models.
Stackforce AI infers this person is a Data Engineering expert in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringData WarehousingEtl Development

Other Skills

ADLAWS Cloud TechnologiesAWS GlueAgentic AIAirflowAmazon AthenaAmazon EC2Amazon EMR (Big Data Platform)Amazon RDSAmazon RedshiftAmazon S3Amazon Web Services (AWS)Apache AirflowApache KafkaApache Spark

About

• Over the course of my working experience in Information Technology including Data Warehouse/DataMart development using ETL tools Informatica (IICS, Power Center), Azure Data Factory (ADF), Fivetran, SSIS & BI Tool Power BI. • Hands on Experience in Snowflake cloud Data Warehouse. • Experience in Using data build tool (dbt) for Transformations. • Worked on various domains including Oil & Gas, Health Care, Manufacturing & Retail. • Interacted with end-users and functional analysts to identify and develop Business Requirement Document (BRD) and transform it into technical requirements. • Good exposure in overall SDLC including requirement gathering, development, testing, debugging, deployment, documentation, and production support. • Expertise in creating very detailed design documents and performing Proof of Concepts (POC). • Experience in Medallion Architecture (Bronze, Silver, and Gold Layers) Implementation. • Experience in Data Lake, Data warehousing, Lakehouse environment. • Good knowledge of Data warehouse concepts and principles (Kimball/Inman) - Star Schema, Snowflake, SCD, Surrogate keys, Normalization/De normalization. • Experience in Data Analysis, Data Modelling (Logical and Physical Data Modelling) for the Data Warehouse. • Experience in Enterprise Data warehouse (EDW), Operational Data Store (ODS). • Experience in integration of various data sources with Multiple Relational Databases like Oracle, Teradata, SQL Server, MS Access and Worked on integrating data from flat files, APIs. • Experience in developing ETL/ELT for supporting Data Extraction, transformations and loading using Informatica Power Center, Informatica Intelligent Cloud Services (IICS), Azure Data Factory, SSIS. • Experience with Azure Data Factory for Extract and Load. • Experience in SCD (slowly changing dimensions) Type 1, Type 2 mappings. • Understanding and working knowledge of CDC (Change Data Capture), Incremental Loading. • Extensively created mapplets, common functions, reusable transformations, look-ups for better usability. • Experience in using Teradata TPT Load Utility within Informatica. • Extensive experience in Tuning and scaling the procedures for better performance by running explain plan and using different approaches like hint and bulk load. • Extensively used SQL, PL/SQL in writing Stored Procedures, Functions, Packages and Triggers. • Knowledge in scheduling tool Control-M. • Experience in Python Programming Language. • Experience in Databricks. • Experience in Airflow Orchestration tool.

Experience

3 yrs 3 mos
Total Experience
3 yrs 3 mos
Average Tenure
--
Current Experience

Conocophillips

Sr. Data Engineer

Oct 2016Present · 9 yrs 8 mos · Greater Houston

ETL toolsInformaticaAzure Data FactoryPower BISnowflakeData Engineering+1

Upmc

Sr. Data Warehouse Lead

Jun 2015Sep 2016 · 1 yr 3 mos · Greater Pittsburgh Region

  • Extracting the data from Clarity Tables and Loading into Oracle Data Warehouse using ETL Tool Informatica Powercenter 9.6.1.
  • worked on Physician and Hospital Applications.
  • Designed Star Schema for Data Warehouse.
  • Implementing Slowly Changing Dimensions (SCD, Both Type 1 & 2).
  • knowledge on HL7 files.
  • worked on ICD-10 changes and loaded tables.
  • worked on Data Modeling - Dimensional modeling STAR schema, loaded dimension & fact tables.
  • Dimension Tables and Fact Table are loaded for OBIEE Reporting.
  • worked with OBIEE Reporting Team and involved in OBIEE Reports Analysis.
  • worked on Informatica Administrator Console, created repositories, users, groups assigned roles.
  • Involved in POCs on Informatica Master Data Management (MDM Hub 10),Match/Merge process.
  • Used Schema(Model) to configure Exact Matching column and Matching Rule for Match/Merge
  • setup, used Batch Viewer(Utilities) and Executed Match to find set of matching rows;
  • used Auto Merge to merge rows.
  • Used Data Manager, Merge Manager (Data Steward) in Informatica MDM HUB 10.
Informatica PowercenterOracle Data WarehouseStar SchemaSCDOBIEEData Warehousing+1

National oilwell varco

Sr. ETL/BI Developer

Feb 2015Jun 2015 · 4 mos

  • Extracting the data from Oracle ERP Tables and Loading into Data Warehouse.
  • Assisted Business Analyst with drafting the requirements, implementing design and development of various components of ETL for various applications.
  • Analyzed Data Specification Documents (DSDs) and implemented their logic in the form of ETL design.
  • Analyzed requirements from the users and created, reviewed the specifications for the ETL.
  • Participated in system design and feasibility analysis discussions.
  • Interacted comprehensively with the Data Modeler/Architect and Business Analyst to understand the model and nature of data to be transformed and loaded into Data Warehouse.
  • Designed Star Schema for Data Warehouse.
  • Good experience in using various Pentaho Data Integration (PDI) steps in cleansing and loads the data as per the business needs.
  • Experience in developing Pentaho Jobs (.KJB) and Transformations (.KTR).
  • Worked on Pentaho Data Integration/Kettle - Spoon, Pan, Chef, Carte and Kitchen.
  • Used various Pentaho transformations like Add a checksum, Sort rows, Calculator, Add Sequence, String Operations, Strings cut, select values etc.
  • Used Change Data Capture (CDC) to simplify ETL in data warehouse applications.
  • Involved in POCs on Informatica Big Data Edition, understanding Native, Hive Environment, Map Reduce jobs, Hadoop Cluster concepts.
  • Involved in importing the powercenter mapping into developer tool and run the mapping on Hadoop Cluster using PDO Hive connection. This mapping functionality is Aggregate information of all products shipped, status of shipment, discounts and taxes applied.
  • Involved in creating HDFS connection, Hive connection and creating HDFS mappings, Hive mappings in Developer Tool, Monitored mapping runs from Monitoring console.
Oracle ERPPentaho Data IntegrationStar SchemaChange Data CaptureETL DevelopmentData Warehousing

Conocophillips

2 roles

Data Engineer

May 2014Feb 2015 · 9 mos

  • Worked on various projects including Transition project for Phillips66 and Production support, Operations for few Applications.Involved in Business Analysis and Requirements collection.
  • Worked on EagleFord IOF (Integrated Operations of the Future) IDW Project. Extracted data from Oracle and populated into Teradata Warehouse using ETL Tool Informatica PowerCenter.
  • Worked on PPDM data model Tables.
  • Used TPT Connector to load the data into Teradata using Informatica.
  • Used Informatica Full Pushdown Optimization (PDO) Technique for better performance.
  • Used SCD Type 2 Mappings to maintain current and historical data.
  • Worked on Informatica B2B DX to place the files from one location to other.
  • Worked on Informatica B2B DT, worked on unstructured data files, used parser and converted to xml file.
  • Worked on Loading SAP B/W Tables using Informatica Powercenter, Extracting the data from SAP R/3 Adapters sources using Informatica SAP Power connect.
  • Extensively Did Basic Functionality Testing of Informatica Upgrade versions 9.1/9.5.1.
  • Used Informatica GRID implementation.
  • worked on Informatica Data Quality (IDQ).
  • Involved in On Call for Production Support.
Informatica PowerCenterTeradataSCD Type 2Informatica B2BData EngineeringETL Development

Data Engineer

Oct 2011Apr 2014 · 2 yrs 6 mos

  • ETL Development.
ETL DevelopmentInformatica

--

ETL/BI Developer (Informatica with SAP R/3 Sources)

May 2011Oct 2011 · 5 mos

  • Loading data from SAP R/3 Tables into SQL Server Warehouse using ETL Tool Informatica Power Center Designer.
  • Generate and Installed SAP ABAP Programs in File mode and Stream mode in Mapping Designer.
  • Worked on ABAP Program Transport with SAP BASIS team to transport from Dev to Test and then production Environment along Informatica code migration.
  • Handled slowly changing dimensions of Type2 to populate current and historical data to dimensions and fact tables in the Data Warehouse.
  • Prepared Unit Test Plan (UTP) documents for all the test cases for the developed mappings.
Informatica Power CenterSAP R/3SQL ServerETL Development

Education

University of Dayton

Master's degree — Electrical & Computer Engineering

Jan 2009Aug 2011

Stackforce found 100+ more professionals with Data Engineering & Data Warehousing

Explore similar profiles based on matching skills and experience