Sujoy Das

Data Engineer

Bengaluru, Karnataka, India4 yrs 4 mos experience
Most Likely To Switch

Key Highlights

  • Achieved 50% increase in receivables through data solutions.
  • Implemented Azure Data Factory pipelines for automated data ingestion.
  • Led migration of big data workloads to Azure Databricks.
Stackforce AI infers this person is a Data Engineering specialist in the SaaS industry.

Contact

Skills

Core Skills

Data EngineeringData MigrationEtl

Other Skills

Active DirectoryAgile MethodologiesApacheApache AirflowApache FlinkApache SparkAutomic (Software)Azure Data FactoryAzure Data LakeAzure DatabricksAzure Key VaultAzure Logic AppsAzure SQLAzure Streaming AnalyticsBash

About

As a Data Engineer at Larsen & Toubro, I delivered data solutions within the Microsoft Azure ecosystem, using my strong problem-solving skills and solid technical foundation. I developed and implemented Azure Data Factory pipelines to automate data ingestion from four project sites, defined and ensured data quality checks, cleaned and joined diverse datasets using Azure Databricks, and loaded final data into SQL Database for access by data analysts. These data-driven solutions yielded impressive results, such as a 50% increase in receivables, a 40% faster project execution, and a 40% improved data analysis workflow. I hold a Master's in Big Data Analytics from Trendy Tech. My education background and proficiency in Python, SQL, and PySpark equip me to navigate the world of Big Data technologies and cloud solutions. I'm adept at data ingestion, transformation, and analysis using tools like Azure Data Lake, Databricks, Data Factory, and Synapse Analytics. I have an extensive knowledge in Lakehouse Fundamentals, Delta Lake optimizations, and Data Warehousing principles. In addition to Azure, I have hands-on experience in Microsoft SQL Server, Postgresql and MySQL Database Management Systems, as well as Hadoop Technologies like HDFS, Apache Spark, and Apache Hive. I also have knowledge of Business Intelligence (BI) and how to apply them to various data scenarios. I'm passionate about building business-driven solutions that seamlessly connect data and business needs, and I'm always eager to learn new technologies and skills. I'm seeking Data Engineer or Big Data Cloud Developer roles that challenge and utilize my diverse skills across the ETL pipeline, and that align with my values of innovation, collaboration, and ethics.

Experience

Arthya tech solutions private limited - schreiber icc

Data Engineer

Mar 2024Present · 2 yrs · Bengaluru, Karnataka, India · On-site

  • Product Lifecycle Management (PLM):
  • Engaged in migration of data from legacy warehouse by utilizing Qlik Replicate as well as Azure Data Factory for product life cycle management (PLM).
  • Migrated US and Global PLM dashboards to Power BI, improving reporting efficiency and repointed data connections to Azure Databricks in preparation for the retirement of Schreiber's Oracle BAW (Business Analytics Warehouse).
  • Migrated the logic for creating architected tables necessary for the PLM project to Azure Databricks and integrated these tables into Automic workflows for automated daily execution, improving data management efficiency.
  • Leveraged Lakehouse architecture within Azure Databricks to analyze large PLM datasets effectively which enhanced our ability to extract valuable insights for project improvement.

Freelance

Data Engineer

Feb 2023Feb 2024 · 1 yr · Remote

  • 1. Led the migration of on-premise big data workloads to Azure Databricks, resulting in a 30% improvement in processing times.
  • 2. Implemented data partitioning strategies, significantly improving query performance and enhancing overall data retrieval speed.
  • 3. Revamped existing ETL pipelines in Azure Data Factory, introducing parameterization and dynamic mapping for enhanced flexibility.
  • 4. Achieved a 25% reduction in pipeline execution times by optimizing data flow activities and orchestrating dependencies.
  • 5. Implemented a robust security framework by integrating Azure Key Vault into data pipelines, ensuring the secure management of connection strings and sensitive information.
  • 6. Successfully orchestrated data movement between Azure and AWS cloud platforms, enabling seamless integration of data from diverse sources.
  • 7. Collaborated with external APIs and third-party cloud data lakes, establishing a unified data integration architecture.
Qlik ReplicateAzure Data FactoryPower BIAzure DatabricksLakehouse architectureData Engineering+1

Larsen & toubro

2 roles

Data Engineer

Sep 2022Jan 2023 · 4 mos · Ayodhya, Uttar Pradesh, India · On-site

  • Developed and implemented Azure Data Factory pipelines to automate data ingestion per week, from 4 project sites
  • through HTTPS eradicating complete manual workload
  • Defined and ensured data quality checks within Azure Data Factory, ensuring data compliance and facilitating
  • accurate analysis
  • Cleaned and joined diverse datasets using Azure Databricks to extract useful insights
  • Loaded final data into SQL Database for access by data analysts, empowering informed decision-making based on data-driven insights
  • Partnered closely with data analysts to track work progress and resource consumption, fostering collaboration and optimizing data analysis workflows, resulting in 40% improved workflow
Azure DatabricksAzure Data FactorySQL DatabaseData Quality ChecksData EngineeringETL

Senior Engineer

Aug 2021Aug 2022 · 1 yr · Ayodhya, Uttar Pradesh, India · On-site

  • Technical documentation of ₹200Cr project for complex electrical systems, ensuring clear communication across different teams and stakeholders.
  • Spearheaded initiatives that increased recievables by 50% across two consecutive quarters, securing a combined improvement of ₹30 crore and optimizing cash flow.
  • Analyzed project documentation and implemented streamlined workflows and strategies, accelerating project execution by 40% compared to standard methods.
  • Successfully led a team of 5 in deploying pilot digital initiatives developed by R&D, fostering collaboration and driving successful integration of new technologies.
  • Initiated and implemented project management knowledge, leading to standardized practices across the team which improved project success rates by 10%.
  • Took part in developing project cost estimates and resource allocation plans, enabling effective budget forecasting and adherence, and improving financial control.

Kidaptivity technologies

Mathematics Tutor

Sep 2020Dec 2020 · 3 mos · Remote

  • Prepared and implemented lesson plans covering required course topics.
  • Diversified teaching techniques and learning tools help students with differing ability levels and varied learning modalities.
  • Mentored students on individual basis to help develop math skills.
  • Encouraged critical thinking and problem-solving to help students develop mathematical reasoning.
  • Achieved conversion of 5 demo sessions into full time courses.

Internshala

Campus Ambassador

Mar 2018May 2018 · 2 mos · Kolkata, West Bengal, India · On-site

  • Leveraged various social media platforms to increase engagement and reach new audiences, leading to 50% improvement in outreach and awareness on a comparative basis.
  • Developed marketing efforts such as posters to encourage participation for campus events, promoted mission, vision and culture of the organization to prospective students.
  • Set up an internship cell in the college, dedicated to mentor students for upcoming placements or internships.
  • Conducted seminars and discussions to impart the prospects of internships to students.
  • Achieved 500+ registrations and 100% revenue target in sales of services offered through the portal.

Education

Indian Institute of Technology, Delhi

Master of Technology - MTech — Construction Management

Jul 2019Jun 2021

TrendyTech

Masters — Big Data Analytics

Jun 2023Feb 2024

Techno Main - Salt Lake

Bachelor of Technology - BTech — Electrical Engineering

Aug 2015May 2019

Stackforce found 100+ more professionals with Data Engineering & Data Migration

Explore similar profiles based on matching skills and experience