Kunal Chowdhury

Associate Consultant

Kolkata, West Bengal, India15 yrs experience
Highly Stable

Key Highlights

  • 15+ years in data engineering and analytics.
  • Expert in building scalable data platforms.
  • Proven track record in data architecture design.
Stackforce AI infers this person is a Data Engineering expert with a focus on scalable data architecture in the FMCG sector.

Contact

Skills

Core Skills

Data LakesData ArchitectureData AnalysisData ModelingEtl

Other Skills

Amazon RedshiftApache SparkAttitude ChangeAzure Data FactoryAzure DatabricksAzure DevOpsBig DataBusiness RequirementsContinuous Delivery (CD)Continuous Integration (CI)Data ExtractionData GovernanceExtract, Transform, Load (ETL)Fast-Moving Consumer Goods (FMCG)Informatica

About

🔹 With 15+ years of experience in data engineering and analytics, I have designed and optimized enterprise-grade data architectures that power decision-making across industries. My expertise lies in building scalable, high-performance data platforms, ensuring organizations can harness the full potential of their data. 🔹 Databricks & Modern Data Architecture: I specialize in building and optimizing data lakes, lakehouses, and large-scale ETL workflows using Databricks, enabling seamless data processing, real-time analytics, and AI/ML capabilities. I have successfully implemented Delta Lake architectures, ensuring data reliability, governance, and performance at scale. 🔹 End-to-End Data Engineering: Experienced in architecting robust data pipelines from ingestion to transformation and orchestration, leveraging Azure Data Factory, Kafka, Talend, and cloud-native services. I focus on cost-efficient, high-performance processing for structured and unstructured data. 🔹 Business-Driven Data Strategy: Beyond engineering, I bridge the gap between technology and business value, ensuring data platforms align with enterprise goals. From real-time streaming solutions to advanced analytics enablement, my solutions drive efficiency, automation, and innovation. 🔹 Scaling & Optimizing Cloud Data Workloads: Skilled in distributed computing and performance tuning, I ensure optimized execution of large-scale data transformations, minimizing latency and maximizing resource efficiency in cloud environments. I am passionate about advancing modern data ecosystems, staying ahead of evolving technologies, and mentoring teams to build future-ready data platforms. Let’s connect and explore data-driven transformation together. ✉ ckunalsinbox@gmail.com

Experience

Genpact

Principal Consultant

Dec 2023 – Present · 2 yrs 3 mos · Kolkata, West Bengal, India · Hybrid

Mathco

Delivery Manager

Dec 2022 – Dec 2023 · 1 yr · Kolkata, West Bengal, India · Remote

Data LakesBusiness RequirementsData ExtractionAzure Data FactoryWorking ExperienceExtract, Transform, Load (ETL)+7

Pepsico

2 roles

Data Architect

Promoted

Dec 2021 – Dec 2022 · 1 yr

  • ★ Designed and implemented a data architecture that met the business needs of the organization, resulting in improved data accessibility and analysis capabilities
  • ★ Collaborated with stakeholders to understand their data needs and requirements, leading to the successful implementation of data-driven initiatives
  • ★ Identified and evaluated new technologies and tools, such as data lakes and cloud-based data warehouses, to improve the organization's data architecture
  • ★ Developed and maintained data governance policies and standards, ensuring that data was managed and used in a responsible and compliant manner
  • ★ Integrated data from a variety of sources and systems, streamlining data access and analysis processes
  • ★ Implemented data security measures to protect sensitive data, improving data privacy and compliance
  • ★ Ensured data quality and integrity through the use of appropriate processes and tools, resulting in more reliable and accurate data
  • ★ Provided technical guidance and leadership to data engineers and other team members, fostering a collaborative and efficient work environment
  • ★ Stayed up-to-date with industry trends and best practices in data architecture, leading to the adoption of innovative solutions and practices within the organization.
Data LakesBusiness RequirementsData ExtractionAzure Data FactoryWorking ExperienceExtract, Transform, Load (ETL)+7

Lead Engineer

Nov 2019 – Dec 2021 · 2 yrs 1 mo

Data LakesBusiness RequirementsData ExtractionAzure Data FactoryWorking ExperienceExtract, Transform, Load (ETL)+5

Infosys

Technology Lead

Aug 2018 – Oct 2019 · 1 yr 2 mos · Hyderabad Area, India

  • ★ Worked actively in TD upgrade from V14.10 to V16
  • ★ Transformed Logical Data Model to Physical Data Model ensuring the Primary Key and Foreign key relationships in PDM, Consistency of definitions of Data Attributes and Primary Index considerations.
  • ★ Developed macros and procedures to populate the customer data warehouse with transaction data, cycle and monthly summary data, and historical data.
  • ★ Worked on optimizing and tuning Teradata views and SQL’s to improve the performance of batch and response time of data for users.
  • ★ Worked on Hadoop cluster using IBM Datastudio (BigSQL) tool for data load to TD Marts.
  • ★ Provided initial capacity and growth forecast in terms of Space, CPU for the applications by gathering the details of volumes expected from Business.
  • ★ Prepared low level technical design document and participated in build/review of the BTEQ Scripts, FastExports, Multiloads and Fast Load scripts, Reviewed Unit Test Plans &System Test cases.
  • ★ Provided quick production fixes and proactively involved in fixing production support issues.
  • ★ Used and automated Teradata ARCMAIN utility to copy data and objects such as tables from one environment to another.
Data LakesBusiness RequirementsData AnalysisData ExtractionWorking ExperienceExtract, Transform, Load (ETL)+3

Cognizant

Associate

Dec 2015 – Aug 2018 · 2 yrs 8 mos · Hyderabad Area, India

  • ★ Experience in maintenance and configuration of user accounts for dev, QA and prod servers and created roles for EC2, RDS, S3, Cloudwatch, EBS resources to communicate with each other using IAM.
  • ★ Experience in migrating and implementation of multiple applications from on premise to cloud using AWS services like SMS, Cloud formation, S3, Route 53, Glacier.
  • ★ Build and configure a virtual data center in the Amazon Web Services cloud to support EDW hosting including VPC, Private and Public subnets, Security Groups, RTs, ELBs.
  • ★ Build servers using AWS, importing volumes, launching EC2 instances, RDS, auto scaling, load balancers in the defined virtual private connection.
  • ★ Training and educating resources to leverage cloud architecture in existing projects.
  • ★ Performed data analysis and gathered columns metadata of source systems for understanding requirement feasibility analysis.
  • ★ Created Logical Data flow Model from the Source System study according to Business requirements on MSVisio.
  • ★ Transformed Logical Data Model to Physical Data Model ensuring the Primary Key and Foreign key relationships in PDM using Erwin DM.
  • ★ Provided initial capacity and growth forecast in terms of Space, CPU for the applications by gathering the details of volumes expected from Business.
  • ★ Written automation scripts using MVC and ARCMAIN utility for space compression and data migration from production to lower environments.
  • ★ Done the impact assessment in terms of schedule changes, dependency impact, code changes for various change requests on the existing Data Warehouse applications that running in a production environment.
Data AnalysisData ExtractionData ModelingExtract, Transform, Load (ETL)Attitude Change

Ibm india private limited

Senior Application Developer

May 2014 – Nov 2015 · 1 yr 6 mos · Greater Hyderabad Area

  • ★ Was involved in end to end DWBI process including requirements analysis, data scrutiny, design, development and testing.
  • ★ Involved in analyzing / building Teradata EDW using Teradata ETL utilities and Informatica Power Center.
  • ★ Worked closely with analysts to come up with detailed solution approach design documents.
  • ★ Worked with complex SQL queries to test the data generated by the ETL process against the target database.
  • ★ Done the impact assessment in terms of schedule changes, dependency impact, code changes for various change requests on the existing Data Warehouse applications that running in a production environment.
  • ★ Provided quick production fixes and proactively involved in fixing production support issues
  • Coordinate with Configuration management team in code deployments.
Data AnalysisData ExtractionExtract, Transform, Load (ETL)

Infosys

Senior System Engineer

Dec 2010 – Apr 2014 · 3 yrs 4 mos · Greater Chennai Area

  • ★ Prepared Business requirement documents, ETL specification documents according to the business requirements from clients.
  • ★ Worked on Teradata Store procedures and functions to conform the data and load it on the table.
  • ★ Tuning SQL Queries to overcome spool space errors and improve performance.
  • ★ Worked extensively in Tuning queries by elimination cursor based store procedure and using the set based UPDATE statements.
Extract, Transform, Load (ETL)ETL

Education

Neotia Institute Of Technology, Management and Science (Formerly ITME)

Bachelor of Technology - BTech

Jan 2006 – Jan 2010

Stackforce found 100+ more professionals with Data Lakes & Data Architecture

Explore similar profiles based on matching skills and experience