Zain Abbas

Associate Consultant

Lucknow, Uttar Pradesh, India4 yrs 7 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Led pivotal projects in Data Migration and ELT initiatives.
Certified Databricks Professional Data Engineer.
Recognized for collaborative leadership and exceeding client expectations.

Stackforce AI infers this person is a Data Engineer specializing in Data Migration and ELT solutions within the SaaS industry.

Contact

zain.abbas@celebaltech.com LinkedIn

Skills

Core Skills

Data EngineeringData MigrationData QualityData ScienceData Analysis

Other Skills

Apache SparkApplication of Soft ComputingAzure Data FactoryAzure Data LakeAzure DatabricksBladebridgeCCascading Style SheetsCompiler DesignCore JavaData PipelinesData StructuresDatabasesDatabricksEnglish

About

With total 4 years of experience, I've led pivotal projects in Data Migration and ELT initiatives. Proficient in Python, SQL, PySpark, Databricks, Azure. Certified Databricks Professional Data Engineer. Skilled in architecting optimized Data Pipelines for secure, reliable solutions & Migration. Recognized for collaborative leadership and surpassing client expectations. Let's connect! I'm passionate about data-driven innovations, collaborative projects, and fostering meaningful professional connections. 🚀 Proficient in SQL for efficient data manipulation and querying. 🛠️ Hands-on experience with Azure Data Factory for ETL pipelines. 🐍 Skilled in PySpark for big data processing and analysis. 🔧 Experienced with Databricks for scalable data engineering workflows. 🌐 Knowledgeable in BladeBridge for seamless migration. 🌌 Familiar with Azure Synapse for high-performance analytics.

Experience

4 yrs 7 mos

Total Experience

4 yrs 7 mos

Average Tenure

4 yrs 7 mos

Current Experience

Celebal technologies

2 roles

Associate Consultant Data Engineer

May 2024 – Present · 2 yrs 1 mo · Noida, Uttar Pradesh, India · On-site

Big Data and EDW

Associate Data engineer

Nov 2021 – Jun 2024 · 2 yrs 7 mos · Noida, Uttar Pradesh, India · On-site

Transformed T-SQL stored procedures into PySpark/SparkSQL for advanced analytics at an insurance company.
Implemented notebook invocation within Databricks, streamlining processes.
Improved code reliability with exception handling and through testing.
Migrated HANA sidecar to Azure Databricks for scalability at a petrochemical company.
Converted HANA Calculation Views to PySpark/SQL for efficient processing.
Integrated notebooks into Data Factory pipelines for smoother workflows.
Established Master Data Management for data integrity at a sports company.
Created a central master table for consistent data representation.
Developed ETL pipelines for seamless data movement and enhanced data quality using Azure Databricks.
Implemented a data ingestion pipeline using Azure Databricks and ADLS to extract data from multiple sources such as Azure SQL Database, Azure Blob Storage, and other external sources.

PySparkSQLDatabricksAzure Data FactoryData MigrationData Pipelines+1

Acg world

Data Engineer

Jun 2021 – Nov 2021 · 5 mos · Remote

Worked as a Data Engineer intern with a team in the IIOT function for creating integrated machines and its
predictive analytics.
● Analyzing IIOT big Datasets.
● Written Automated script in Python and pyspark for daily extraction and handling big data from azure data lakes.
● Provided Business Intelligence solutions to the company which are used by employees to make data-driven
decisions.
● Took care of the internal problem and implemented goal-oriented strategies for solving them.
● Performed various analyses and worked on focused groups creating reports.
Skills Learned: Pyspark, Azure Databricks,SQL.

PythonPySparkSQLData Engineering