BISHAL KUMAR MAJHI — Data Engineer
- Skilled Big Data Engineer with 3.1 years of outstanding performance record in designing and implementing efficient ETL processes. - Proficient in Azure Cloud and PySpark. Proficient in Python, SQL,Pyspark and cloud-based data platforms. - Master in collaborating with cross-functional teams to deliver high-quality solutions saving project costs by around 20%. - Led the design and implementation of an Data pipeline, reducing data processing time by 25%. - Reduced redundant activities of 3 departments by Building Data Warehouse, Data modeling and Data Ingestion activities. - Implemented data quality checks, resulting in a 15% improvement in data accuracy. - Conducted performance tuning on SQL queries, optimizing data retrieval by 20%. - Migrated On premise Data Distribution to Azure Cloud Distribution and Hive Data Warehouse using Pyspark in less than 1 week. - Adept at handling diverse file formats, notably Parquet. - Proficient in using JIRA for project management and tracking, and experienced in code review processes. - Demonstrated ability to quickly learn and adapt to new technologies. - Facilitated in POCs for Data migration to Azure delivering 100% efficiency. - Achieved 100% consistency in a team of 4 members, towards driving POCs on Data workflow in Azure Data Factory. - Strengthened POCs to set up Devops environment using Jira, Azure code deploy on Databricks and ADLS Gen2 environments. - Achieved proficiency in Azure Data Factory, Databricks, ADLS Gen2, Delta lake and other Azure services. - Mastered with 100% consistency, in Hive queries by creating and querying HIVE tables to retrieve useful analytical information. - Initiated use of Sqoop to import large data on 10 machines from traditional RDMS to HDFS. - Pioneered in Data Crunching, Data Ingestion, Data Transformation Activities.
Stackforce AI infers this person is a Big Data Engineer specializing in Azure Cloud and ETL processes.
Location: Hyderabad, Telangana, India
Experience: 3 yrs 6 mos
Skills
- Data Engineering
- Azure Cloud
Career Highlights
- Reduced project costs by around 20% through collaboration.
- Achieved 100% efficiency in data migration POCs.
- Improved data accuracy by 15% with quality checks.
Work Experience
Incedo Inc.
Senior Data Engineer (7 mos)
SAS2PY
Data Engineer (2 yrs)
LevelUp
Software Developer (5 mos)
SoftDevels Private Limited
Junior Developer (5 mos)
Education
Master of Computer Applications - MCA at Biju Patnaik University of Technology, Odisha