Jun 2020 – Sep 2024 · 4 yrs 3 mos · Kolkata, West Bengal, India

• ➥ Led a cross-functional team while serving retail and banking clients in the US and UK, adeptly applying agile methodologies to deliver tailored data engineering solutions.
• ➥ Developed highly optimized stored procedures, functions, and variables in Snowflake to extract data from various sources and integrate with pipelines, including tasks triggered via Cron timer and Streams for Change Data Capture (CDC).
• ➥ Conducted bulk loading from external and internal stages (AWS S3 to Snowflake, CSV/Excel to Snowflake) and utilized FLATTEN table function for lateral views of VARIANT, OBJECT, and ARRAY columns.
• ➥ Enhanced query efficiency through indexing, materialized views, and data masking techniques for privacy.
• ➥ Managed Snowflake admin tasks including access, roles, permissions, and cost calculation.
• ➥ Utilized AWS services (EC2, S3, DMS, IAM, CloudWatch) to design and manage scalable cloud infrastructures, deploying EC2 instances, S3 buckets, and IAM policies for secure operations.
• ➥ Configured QLIK Replicate and Enterprise Manager in AWS EC2 instances, extracting data from Oracle and SQL Server sources and loading into Snowflake tables, with tasks handling CDC and real-time changes.
• ➥ Implemented strategies for purged, non-purged, and large object data tables, staging data files in S3 buckets for loading, and optimizing loading speed through parallel loading techniques.

Apr 2016 – May 2020 · 4 yrs 1 mo · Kolkata, West Bengal, India

• ➥ Developed parameterized stored procedures in SQL Server, optimized for efficient data extraction and loading via SSIS pipelines. Utilized various SSIS tasks like Conditional Split, Multicast, and Fuzzy Lookup for data scrubbing and validation during staging.
• ➥ Managed data import/export between diverse sources (Snowflake, Teradata, SQL Server, Excel, CSV) using SSIS/DTS utility. Designed reports with parameter acceptance and created SSIS packages in BIDS for Data Management applications.
• ➥ Implemented highly optimized stored procedures, functions, and variables in Snowflake to integrate data from diverse sources. Utilized Snowflake tasks for scheduling, Change Data Capture (CDC), and performed bulk loading from AWS S3.
• ➥ Leveraged import/export functionality to facilitate seamless data movement between internal and external stages, ensuring efficient data flow across AWS S3, CSV/Excel, and Snowflake environments.

Aug 2010 – Mar 2016 · 5 yrs 7 mos · Kolkata, West Bengal, India

• ➥ Developed intricate reports, mastering concepts like Master-Detail relationships, Report Bursting, and Conditional Formatting.
• ➥ Proficient in Report Studio, Query Studio, Cognos Connection, and Dashboard preparation across IBM Cognos Analytics 11.1.7 and IBM Cognos 10.2.2 versions.
• ➥ Scheduled reports with precision, using both event-based and time-based triggers.
• ➥ Expertly harnessed data from Teradata, SQL Server, Oracle, and Snowflake, employing features like Join, Union, and Intersect to create comprehensive multi-tab reports.
• ➥ Excel aficionado: Power Query, Power Pivot, Macros, Pivot Tables, Charts, and advanced functions.