Sparsh Nagpal

Data Engineer

Gurgaon, Haryana, India2 yrs 11 mos experience

Key Highlights

  • Expert in managing large-scale data workflows.
  • Proficient in Python and PySpark for data transformation.
  • Strong background in both hardware and software engineering.
Stackforce AI infers this person is a Data Engineer specializing in large-scale data processing and workflow automation.

Contact

LinkedIn

Skills

Core Skills

Data EngineeringWorkflow Automation

Other Skills

CC++CA7CommunicationData StructuresGitHubHadoopHueImpalaJenkinsLeadershipManagementOozieProject ManagementPySpark

Experience

2 yrs 11 mos
Total Experience
2 yrs 11 mos
Average Tenure
2 yrs 11 mos
Current Experience

Incedo inc.

Software Developer

Jul 2023 – Present · 2 yrs 11 mos · Gurugram, Haryana, India · Hybrid

  • Leverage Hadoop, Hue, Impala, Udeploy, and Jenkins to manage and process large-scale datasets with precision and efficiency.
  • Develop and maintain Oozie workflows and partition tables, ensuring seamless integration of incoming data into critical business tables.
  • Engineer robust PySpark, Python, and Batch scripts that power transformation and cleansing processes for CSV and Excel files.
  • Automate data workflows and scripts using CA7, optimizing timing and location-based triggers to enhance operational efficiency.
  • Craft complex SQL queries on processed data, enabling advanced analytics that fuel insightful business dashboards and visualizations.
HadoopHueImpalaUdeployJenkinsPySpark+5

Education

Thapar Institute of Engineering & Technology

Bachelor of Technology - BTech — Electronics and computer

Delhi Public School Vasant Kunj

High school — Non medical

Blue Bells Model School

Class X

Stackforce found 100+ more professionals with Data Engineering & Workflow Automation

Explore similar profiles based on matching skills and experience

Ronan Collobert

Ronan Collobert

Research Scientist

at Apple

Menlo Park, United States25 yrs 1 mo exp
Machine LearningResearch
Mike Thacker-Cooke

Mike Thacker-Cooke

Director of Recruitment

at KDR Talent Solutions

Middlewich, United Kingdom13 yrs 11 mos exp
Data RecruitmentTechnology RecruitmentBusiness Intelligence RecruitmentData Management Recruitment
Deepak Gupta

Deepak Gupta

Talent Acquisition Group-Leadership Hiring (PAN India)

at EPAM Systems

Delhi, India16 yrs 3 mos exp
Talent AcquisitionLeadership Hiring
Mani Bhushan

Mani Bhushan

Engineering leader

at OrbitronAI.com

Bengaluru, India10 yrs 7 mos exp
System ArchitectureCross-functional Team LeadershipGeospatial DataGeospatial IntelligenceAmazon Web Services (AWS)
Cheng Niu

Cheng Niu

Distinguished Research Scientist

at News Break

San Francisco, United States20 yrs 5 mos exp
Machine LearningNatural Language ProcessingArtificial Intelligence
Rebecca Lotus

Rebecca Lotus

Author & Speaker

at The Human Work

Steilacoom, United States16 yrs 9 mos exp
LeadershipWritingSoftware ManagementEngineering ManagementAPI Development
Emma Hershberger (Cockram)

Emma Hershberger (Cockram)

Software Engineering Manager

at Ulteig

Wabasha, United States4 yrs 9 mos exp
Project ManagementSoftware ArchitectureContinuous Integration and Continuous Delivery (CI/CD)Full-Stack DevelopmentAzure DevOps
Jason Martin

Jason Martin

VP FDE

at Databricks

San Francisco, United States33 yrs 5 mos exp
Professional ServicesConsulting