Biswajit Sarkar — Associate Consultant
• Total 4+ years of working IT experience (1+ years in Azure Data Engineering & 3 + years in ETL Testing) .• Current role as Azure Data Engineer with a working in the Retail domain.• Skilled in Azure Data Factory, Azure Databricks, Pyspark, Spark SQL, SQL Server, Azure SQL Database, Azure Key Vault, Azure Synapse Analytics, HDFS, Hive, ETL Testing, Data Warehouse Testing and Database Testing• DataBricks and Microsoft Certified Azure Data Engineer.working on Projects which involve roles and responsibilities:-The project aims to create a data pipeline that extracts data from a source, processes it, and loads it into a destination. The pipeline will be built using Azure Data Factory, IT will use ADLS Gen2 as the storage solution, The data processing is getting done by Azure Data Bricks using PySpark and Spark SQL, also data are getting stored in 3 layers and on the top of final layer Data is getting stored in Delta Table of DataBricks, Reporting team can directly consume the data, in these all work various complex transformation and optimization have implemented using Pyspark and Spark SQLAll the changes are getting deployed in higher environment using Azure DevOps CI/CD, and versioning and code repository is getting managed by Azure Devops Git.• Preparing test cases and test plan•Fixing defects in JIRA.• Working with the QA team for fixing the defects.• Following Requirement Traceability Matrix and framing test case and SQL queries according to Business Requirement Document.•Working in Agile methodology.
Stackforce AI infers this person is a Data Engineer specializing in Azure technologies within the SaaS industry.
Location: Kolkata, West Bengal, India
Experience: 4 yrs 3 mos
Skills
- Azure Data Engineering
- Etl Testing
Career Highlights
- Over 4 years of IT experience in Azure Data Engineering and ETL Testing.
- Expert in building data pipelines using Azure Data Factory and Databricks.
- Certified Azure Data Engineer with strong skills in data transformation.
Work Experience
PwC India
Senior Associate (10 mos)
Tata Consultancy Services
System Engineer (TCS Digital Cadre) (1 yr 8 mos)
Assistant System Engineer (10 mos)
Assistant System Engineer Trainee (11 mos)
Education
Bachelor of Technology - BTech at Academy of Technology
Higher Secondary at Kanchrapara Harnett High school
Secondary Examination at Kanchrapara Harnett High School