Nitesh Chaudhry

Data Engineer

Hyderabad, Telangana, India5 yrs 6 mos experience
Most Likely To Switch

Key Highlights

  • Led data engineering for AI use cases at Naukri.com
  • Built Walmart's financial data backbone
  • Expert in PySpark and Big Data technologies
Stackforce AI infers this person is a Data Engineering expert in Fintech and SaaS environments.

Contact

Skills

Core Skills

Data EngineeringData AnalyticsBig DataData Science

Other Skills

API DevelopmentAirflowAnalytical SkillsApache AirflowApache KafkaApache SparkApplied Machine LearningComputer ScienceContinuous Integration and Continuous Delivery (CI/CD)Data AnalysisData MiningData ModelingData ModelsData PipelinesData Structures

About

I Lead the Data Engineering team @naukri.com(India's largest hiring platform), Within the Data Science Org. I have experience of 4+ Yrs @ Fortune top 5 companies(Walmart & UnitedHealth Group).Apart from Spark+GCP+Open source Hadoop stack, I have prior experience in data science,ML,data visualization & analysis as well. Resume Link : tinyurl.com/ResumeNitesh Since joining Naukri, I have been leading the data Engineering division, for AI-related use cases, and being the subject matter expert for pyspark within the org. I have worked on building Walmart's data backbone for all kinds financial data, world's largest by dollar value, With all the logic in one place/platform, also served various domains like retail, fintech, healthcare, insurance,hiring. Key tech Skills ; • Programming Languages: Python,Scala,C++, java • Big data tools and frameworks : Advanced SQL , spark , pyspark , akka-http , akka , hive, Bigquery, Google cloud, Kafka , airflow, HDFS, Hadoop, spark streaming * Worked on both real-time and streaming use cases. * Worked on data lakes and warehouses. * Experience with data analytics using BigQuery, Advanced SQL, Hive, Jupyter Notebooks,numpy,Pandas,pyArrow * Built automated integrations of Big data jobs with platforms like Salesforce , ServiceNow, Bigquery , Google Cloud storage. Other past experiences : • Experience of working on Data Science problems while taking care of the entire pipeline from data collection to Model creation . Worked as a Data Scientist Intern at Samaaru India(Domain : Agri-tech) , Bangalore , on Crop price prediction in India • Kaggle Notebooks Expert. Proficient in writing code in python and working with ML algorithms. • Created and mentored UltimateSecurityCam ,an open-source project in python using OpenCV. As a part of NWoC @ IIT Patna ,2018 . The project can automate surveillance and alert the owner if a security breach is detected ! • Coding in C++ since 2013. 4-star coder on Codechef. Top-100 ranked in a few Coding contests. • Actively participating in ML competitions. • Skills : PYTHON | C++ | SCALA | SHELL SCRIPTS | APACHE SPARK | PYSPARK | Advanced SQL | HIVE | UNIX Big Data | ETL | Data Pipelines | Data Analysis | Jupyter Notebooks | Pandas | Data Visualization | Data Lake | Data Science | Devops | Data Warehousing | Statistics | Google Cloud Platform(GCS)

Experience

5 yrs 6 mos
Total Experience
1 yr 4 mos
Average Tenure
2 yrs
Current Experience

Microsoft

Data Engineer 2

Jun 2024Present · 2 yrs · Hyderabad, Telangana, India · Hybrid

  • Owns the Key OKR of Microsoft Store , assist the leadership & product team with data-driven decision making.
  • Owning multiple data pipelines that gather all business-critical data and creating useful dashboards out of them
  • Enabled experimentation data pipelines + analysis using The azure exp platform,enable A-B testing and create scorecards & metrics for them.
  • Helped Improve the Key OKR of the org by 15% ,working with : Senior Leadership, Data Scientist, Product
  • Managers & Engineering Teams. Created complex business queries & dashboards to track OKRs.
Apache SparkData EngineeringData VisualizationObjectives and Key Results (OKRs)Data Analytics

Naukri.com

Lead Data Platform Engineer, AI & Data Science Org

Jul 2023Jul 2024 · 1 yr · Noida, Uttar Pradesh, India · Hybrid

  • Lead Data Engineer for Data Science & ML team of Naukri.com (INFOEDGE) { India's biggest hiring platform. Creating the open-source big data platform }
  • Responsibilities and acheivements :
  • 1. Architected and implemented the Big Data Platform for AI & Data Science efforts withing the company,involving :
  • a. Powering various AI processes like : Job-to-Job Recommendations , profile-to-Job Recommentations, collaborative ranking of candidate skills. giving tags like "likely-to-join" to candidates based on activity.Creating the data lake by setting up an on-premise HDFS.
  • b. Ingesting batch &streaming data from multiple sources ( AWS S3, MySQL,MongoDb , Kafka)
  • c. Providing spark compute and airflow scheduling, fault tolerance & migrating data science jobs to spark code.
  • d.Creating the Big Data Platform that is robust , stable & scalabe for AI-Driven usecases
Data ModelsDatabasesHands-on Technical LeadershipBig DataPySparkAnalytical Skills+1

Walmart global tech india

2 roles

Data Engineer(SDE-3)

Promoted

Apr 2023Jul 2023 · 3 mos

  • Lead and owned multiple services for the WORLD's LARGEST Big Data Fintech system ( dollar amount ).
  • Developed Batch & streaming pipes, Data archival jobs, Kubernetes and docker images.
  • Used advanced SQL & Bigquery to build automation and auto-monitoring tools in a data-engineering focused team, all while maintaining the highest coding standards.
HadoopData ModelsTroubleshootingData MiningAnalytical SkillsData Engineering+1

Data Engineer(SDE-2)

Sep 2021Apr 2023 · 1 yr 7 mos

Continuous Integration and Continuous Delivery (CI/CD)Apache KafkaSoftware DevelopmentData EngineeringData ModelingData Pipelines+25

Unitedhealth group

Data Engineer

Aug 2020Aug 2021 · 1 yr · Gurugram, Haryana, India

  • Worked as a Big Data Developer on Hadoop ecosystem using Scala , Spark and Hive. Provided solutions to using the power of Data processing !
Continuous Integration and Continuous Delivery (CI/CD)Apache KafkaData ModelingData PipelinesHadoopData Warehousing+9

Twowaits

Educator

Jun 2020Aug 2020 · 2 mos · India · Remote

  • Created course content on data science and engineering.
Continuous Integration and Continuous Delivery (CI/CD)HadoopData ScienceDatabasesTroubleshootingData Engineering

Samaaru india

Data Scientist Intern

May 2019Jul 2019 · 2 mos · Bangaluru

  • Helping the agro & fintech-based company make data-driven decisions. Working on price prediction tasks.
Data EngineeringHadoopData SciencePython (Programming Language)

Indian institute of technology, patna

Student Mentor

Nov 2018Jan 2019 · 2 mos · Remote · Remote

  • Worked remotely as a Project mentor for NJACK Winter Of code.
  • The project deals in computer vision , python programming and working with various python frameworks like opencv.
  • Working on this project helped in better understanding of computer vision and leading an open source project, deploying a user-friendly application and the intricacies of open source development of software.
Continuous Integration and Continuous Delivery (CI/CD)Data ScienceTroubleshooting

Education

Harcourt Butler Technical University

Bachelor of Technology — Information Technology

Jan 2016Jan 2020

Bishop Conrad Sr. Secondary School,Dohna, Bareilly

12th — Non Med + CS

Jan 2007Jan 2015

Bishop Conrad Sr. Secondary School, Dohna, Bareilly

10th

Stackforce found 100+ more professionals with Data Engineering & Data Analytics

Explore similar profiles based on matching skills and experience