Pawan Kumar

Data Engineer

Amsterdam, North Holland, Netherlands15 yrs experience
Most Likely To Switch

Key Highlights

  • 14+ years of experience in data engineering.
  • Expert in building and optimizing data pipelines.
  • Proficient in cloud platforms and data visualization tools.
Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and business intelligence.

Contact

Skills

Core Skills

Data EngineeringCloud PlatformsData ModellingData WarehousingBusiness IntelligenceData AnalysisData VisualizationEtlSoftware Development

Other Skills

AWSAgile (Scrum & Kanban)Agile (Scrum)Agile - ScrumAgile-ScrumAirflowAmazon RedshiftAutomationCloud DevelopmentComplianceContinuous Integration and Continuous Delivery (CI/CD)Dashboard DesignData AnalyticsData LakesData Management

About

I am a Data Engineer with 14+ years of experience in designing, developing, and implementing end-to-end data solutions. My work focuses on building and optimising data pipelines, integrating diverse data sources, and enabling data-driven insights in agile environments. Throughout my career, I have contributed to various projects involving data engineering, data processing, and full-stack implementation of data solutions. I have worked across the entire data lifecycle—gathering requirements from stakeholders, designing data models, developing data pipelines, creating dashboards, and delivering end-to-end solutions with demos to end users. I enjoy exploring new technologies to improve processes and enhance data engineering practices. I have extensive experience across various technical and functional domains, including: - Data Engineering, Data Warehousing, Data Modelling, and Data Analysis – (14+ years) - ETL/ELT Design & Development – Python, Spark, Scala, Airflow, Dagster, Airbyte, MSBI SSIS, Pentaho – (14+ years) - SQL & Distributed Query Engines – SQL, SparkSQL, Trino, Athena, Delta / Databricks, ArcadeDB, Redshift – (14+ years) - Reporting & Data Visualisation – Superset, Power BI, SiSense, Metabase, Tableau, Oracle BI, SSRS – (12+ years) - Requirement Gathering, Requirement Refinement, Project Estimation – (12+ years) - Agile Methodologies – Scrum, Kanban – (12+ years) - Cloud Platforms – Databricks, AWS, Microsoft Azure, Oracle BICS – (9+ years) - Programming & Frameworks – Python, Scala 3, Spark, LinkML, Docker – (9+ years) - Multidimensional Data Modelling – SSAS, ElastiCube – (5+ years) - Web Application Development – Oracle APEX – (2+ years) Industry Domains: Oil & Gas, ESG, Credit Risk Management, Digital Marketing, Telecommunications, Retail, HR, Finance, Procurement, CRM.

Experience

Context labs bv

2 roles

Principal Data Engineer

Promoted

Nov 2023Present · 2 yrs 5 mos · Amsterdam, North Holland, Netherlands · Hybrid

  • In-house: Context Labs, provides software for descriptive and verifiable ESG data and analytics – R&D
  • Description: Designing and developing data processing and management solutions.

Senior Data Engineer

Dec 2022Oct 2023 · 10 mos · Amsterdam, North Holland, Netherlands · Hybrid

  • In-house: Context Labs, provides software for descriptive and verifiable ESG data and analytics – R&D
  • Description: Designing and developing data processing and management solutions.

Abn amro bank n.v.

Senior Data Engineer

Mar 2021Nov 2022 · 1 yr 8 mos · Amsterdam, North Holland, Netherlands · Hybrid

  • In-house: ABN AMRO, a leading Dutch bank - Risk Management
  • Description: Designed and implemented a new data model, quality control measures, and integration processes to enhance data sourcing and processing. Collaborated closely with stakeholders to gather and translate business requirements into technical specifications for the new platform. Led successful migration from old (excel-based) to new (cloud-based) environment.
  • Environment: Microsoft Azure, Databricks, Python, PySpark, SparkSQL, Delta Lake, Git, Power BI, Agile (Scrum)
Microsoft AzureDatabricksPythonPySparkSparkSQLDelta Lake+5

Mendix

Data Operations Lead

Sep 2019Feb 2021 · 1 yr 5 mos · Rotterdam, South Holland, Netherlands · Hybrid

  • In-house: Mendix, a Siemens business to provide a low-code platform - Data CoE
  • Description: Created and implemented a new data warehouse solution from scratch, establishing robust processes for data quality, completeness, and accuracy. Collaborated with stakeholders to ensure compliance with internal and external regulations, leveraging industry best practices.
  • Environment: AWS - Amazon Web Services (Athena, S3, Glue, Redshift, EC2, ECS), Python, Spark, Delta Lake, Airflow, GitLab, Docker, Power BI, Agile (Scrum)
AWSPythonSparkDelta LakeAirflowGitLab+4

Crowd media

Business Intelligence Architect

Oct 2017Aug 2019 · 1 yr 10 mos · Amsterdam, North Holland, Netherlands · Hybrid

  • In-house: Crowd Media (now UNITH), a global digital media company - Data Analytics
  • Description: Led end-to-end ownership of BI data solution for the company, from gathering business requirements to designing, developing, and managing the data pipelines and final insights (dashboards). Guided application team and business partners in applying data quality checks and modelling techniques.
  • Environment: AWS - Amazon Web Services (Redshift, EC2, S3, RDS, SageMaker), Pentaho Data Integration, PostgreSQL, MySQL, Sisense, Jenkins, Python, Jupyter, Git (Bitbucket, GitHub), Agile (Scrum & Kanban)
AWSPentaho Data IntegrationPostgreSQLMySQLSisenseJenkins+6

Accenture the netherlands

Senior Analyst

Nov 2015Sep 2017 · 1 yr 10 mos · Amsterdam, North Holland, Netherlands · On-site

  • Client Project: An American international telecommunications and television company
  • Description: Conducted data analysis and developed data models and dashboards to provide actionable insights for multiple stakeholders. Streamlined procurement, operation coordination, and usage tracking by automating manual processes through Oracle APEX and BI solutions.
  • Environment: Oracle BI / Data Visualization 12c, Oracle APEX, PL/SQL, Python, Oracle BICS, JIRA, Agile-Scrum
Oracle BIOracle APEXPL/SQLPythonOracle BICSJIRA+3

Emc

Data Intelligence Engineer

Oct 2014Oct 2015 · 1 yr · Bengaluru Area, India · On-site

  • In-house: EMC Corporation (now Dell EMC), specialized in data storage solutions - Data CoE
  • Description: Conducted data analysis, developed data models, and ETL processes to generate reports on HR and finance data. Conducted analytics on storage racks logs for data science team's proof of concept.
  • Environment: MSBI (SSIS, SSAS, SSRS), Greenplum, Python, R, T-SQL, SQL Server 2012, TFS (Agile - Scrum)
MSBIGreenplumPythonRT-SQLSQL Server 2012+4

Accenture in india

Software Engineering Analyst

Apr 2011Oct 2014 · 3 yrs 6 mos · Bengaluru Area, India · On-site

  • Client Projects: Worked with multiple multinational clients across the oil & gas, telecommunications, and retail sectors, designing and developing data-driven solutions to streamline operations, enhance performance tracking, and generate actionable insights
  • Description: Developed end-to-end ETL pipelines using MSBI (SSIS, SSAS, SSRS) and SQL Server. Performed data quality checks, transformations, and analysis to ensure accuracy and consistency. Built custom scorecards and pay plan solutions to provide employees with real-time performance insights. Designed interactive dashboards and reports using Tableau and SSRS for business stakeholders. Worked with Hadoop (Hive/Pig) to process large datasets and extract marketing insights. Delivered solutions in Scrum-based environments, using TFS and Apache Subversion (SVN) for version control.
  • Environment: MSBI (SSIS, SSAS, SSRS), T-SQL, SQL Server (2008 R2 – 2012), Python, Hadoop (Hive/Pig), Tableau, SSRS, Team Foundation Server (TFS), Apache Subversion (SVN)
MSBIT-SQLSQL ServerPythonHadoopTableau+5

Hp

Technical Analyst

Sep 2010Mar 2011 · 6 mos · Bengaluru Area, India · On-site

  • Client Project: A British multinational telecommunications services company with head offices in London, UK.
  • Description: Provided ongoing infrastructure support and maintenance for an existing data platform that delivers diverse intranet insights for internal employees.
  • Environment : SQL Server 2008 R2, T-SQL, MS BIDS (SSIS, SSRS), Team Foundation Server (TFS).
SQL ServerT-SQLMS BIDSTeam Foundation Server

Education

Liverpool John Moores University

Master of Science - MS — Data Science

Rajasthan Technical University

Bachelor of Technology (B.Tech.) — Electronic Engineering

Kendriya Vidyalaya

Schooling

Stackforce found 100+ more professionals with Data Engineering & Cloud Platforms

Explore similar profiles based on matching skills and experience