Shirigouda Patil

Data Engineer

Bengaluru, Karnataka, India2 yrs 7 mos experience

Highly StableAI Enabled

Key Highlights

Certified Data Engineer with hands-on experience in data pipelines.
Expertise in Azure and AWS for scalable data solutions.
Strong background in data governance and performance tuning.

Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions for e-commerce.

Contact

Skills

Core Skills

DatabricksEtlData Governance

Other Skills

PythonApache SparkSQLAzure Data FactoryAzure Data Lake StorageData Lake StorageGenerative AIMS ExcelMicrosoft Power BIExtract, Transform, Load (ETL)User StoriesTest CasesStatutory Accounting Principles (SAP)Infrastructure SolutionsInfor Enterprise Resource Planning (ERP)

About

Hi, I am Shrigouda Patil,Data bricks certified data Engineer with 2+ years of experience in designing, developing, and optimizing scalable data pipelines. Expertise in DataBricks, SQL, Python, Apache Spark, Microsoft Fabrick , DBT Tool Gen AI and cloud-based data platforms (AWS, Azure). Passionate about data quality, performance tuning, and enabling data-driven decision-making. Strong background in big data processing, ETL automation, and data governance. Professional Summary: • Hands-on experience in MySQL and Microsoft Excel. . Hands on experience on Python, Pyspark • Hands-on experience to carry out Data Analysis using Python with some of its useful libraries. • Competency in Microsoft applications including Word, Excel, Powerpoint & Outlook. . Having Experience in Azure, AWS · Linux Commands., Shell scripting Advanced Excel features • A strong business sense & critical thinking mindset with ability to work equally well within a team and independently with minimal supervision.

Experience

2 yrs 7 mos

Total Experience

2 yrs 7 mos

Average Tenure

2 yrs 7 mos

Current Experience

L&t technology services

Data Engineer

Nov 2023 – Present · 2 yrs 7 mos · Mysore · Hybrid

Developed an end-to-end e-commerce data pipeline on Azure , integrating transactional and third-party data into an Azure data lake Storage(ADLS). Built ETL workflows using Python, Apache Py spark, Azure Data Bricks and SQL, ensuring data cleansing, typecasting, and deduplication. Leveraged Azure ADF, Azure Data Lake Storage for scalable data processing and storage. Implemented data governance with Data Catalog and real -time monitoring
E-commerce Data Pipeline
 Designed and implemented a scalable ETL pipeline for an e-commerce platform using Azure ADF, Data Lake Storage (ADLS), Data Bricks, Py spark
 Ingested data from various sources (MSSQL, PostgreSQL, CSV, JSON, API) Azure data lake storage for centralized storage.
 Transformed and cleaned data using Py Spark , for analytics and reporting used Power Bi
 Optimized data warehousing in Aws for faster query performance and business insights.
 Automated data orchestration and scheduling with Azure ADF and Azure Functions.

DatabricksPythonApache SparkSQLAzure Data FactoryAzure Data Lake Storage+1