Vijit Vijayvargiya

Data Engineer

Pune, Maharashtra, India2 yrs 4 mos experience

Key Highlights

Expert in building scalable data pipelines.
Proven track record in optimizing data workflows.
Skilled in automating data validation processes.

Stackforce AI infers this person is a Data Engineer specializing in SaaS with a focus on data pipeline optimization and integration.

Contact

vijitv898@gmail.com 8989763090 LinkedIn

Skills

Core Skills

Data EngineeringEtl

Other Skills

ADFAzure Data LakeAzure DatabricksAzure Key VaultC (Programming Language)C++Data AnalysisData GovernanceData IntegrityData ModelingDatabricksETL pipelinesEngineeringEnglishInformation Technology

Experience

Zs

Data Engineer

Nov 2023 – Present · 2 yrs 4 mos · Pune, Maharashtra, India · On-site

1. Designed and developed scalable ETL pipelines and data models using Azure Databricks, ADF, and PySpark to optimize data workflows and improve processing efficiency.
2. Collaborated with cross-functional teams to gather requirements, integrate diverse data sources, and deliver data products that drive business insights and KPIs.
3. Automated data validation processes using PySpark, enhancing data accuracy, reducing manual effort, and ensuring pipeline reliability.
4. Optimized SQL queries and Databricks clusters, reducing infrastructure costs and improving performance for large-scale data processing.
5. Ensured high data quality, governance, and compliance by implementing reusable pipelines, data lineage tracking, and comprehensive documentation.

Azure DatabricksADFPySparkSQLETL pipelinesdata modeling+6