N

Nitin Choudhry

Software Engineer

Vancouver, British Columbia, Canada4 yrs 8 mos experience

Key Highlights

  • Led development of India's first fixed income instrument product.
  • Built a data platform handling 3 billion events daily.
  • Designed machine learning solutions for real-time revenue optimization.
Stackforce AI infers this person is a Data Engineering expert with a strong focus on Big Data and Machine Learning solutions.

Contact

Skills

Core Skills

Data EngineeringPythonMachine LearningBig Data

Other Skills

PostgreSQLsockJenkinsApache KafkaRabbitMQApache SparkMemcachedMongoDBScalaaws s3Apache Spark StreamingKibanaAvroPrestoDistributed Systems

About

Experienced Software Engineer with 9 years of experience in designing and implementing robust data pipelines, optimizing database performance, and leveraging Big Data technologies to drive business insights. Proven track record of leading cross-functional teams and delivering high-impact data solutions.

Experience

4 yrs 8 mos
Total Experience
2 yrs 6 mos
Average Tenure
2 yrs 2 mos
Current Experience

Pinterest

Senior Software Engineer-Data platform

Apr 2024Present · 2 yrs 2 mos · Vancouver, British Columbia, Canada · Remote

Icthru analytics

Co-Founder and Data Platform Consultant

Jun 2023Apr 2024 · 10 mos · Vancouver, British Columbia, Canada · On-site

  • Was involved in design an development of the first fixed income instrument product in India called
  • FIMMI (Fixed Income Money Market India)
  • Development of in house event driven python library which would speed up the writing of micro services at scale .
  • Development of Fetching module -Processing module fetching real time Fixed Instrument Rates from various Banks and NBFC
  • Built big data platform to handle various user interaction over various interfaces.
PostgreSQLPythonsockJenkinsApache KafkaRabbitMQ+3

Expedia group

Machine Learning Engineer III/ Senior Data Engineer

Dec 2020Jun 2023 · 2 yrs 6 mos

  • Design and development of data driven product which could help our lodging partners programmatically increase their revenues by continuously monitoring the market behavior and and providing them opportunities using machine learning in real time across various fronts like availability ,rate ,deals etc
  • Designed generic Scala SDK which could simplify the complete ETL process and make the complete process config driven on top of (Spark ,AWS and Airflow)
  • Built Data pipeline that measures impact of all the Expedia users(100+ million) across different demographic regions and their impact on lodging properties .
MongoDBScalaaws s3Apache Spark StreamingMachine LearningKibana+11

Ht digital streams

Senior Data Engineer

Dec 2018Dec 2020 · 2 yrs · Delhi, India · On-site

  • Built Large scale Data platform to ingest ~3 Billion events a data handling 100 TBs of data every day.
  • Led Data engineering Team to launch world's first fully personalized news publication platform for all users (150+ million) delivering personalized responses in less than 50 ms.
  • Built and managed data platform supporting websites and apps serving 150+ million monthly users globally.
  • Led team to launch propensity based subscription program
MongoDBScalaMySQLApache Spark StreamingsnowplowPython+10

Dunnhumby

Senior Data Engineer

Mar 2017Dec 2018 · 1 yr 9 mos · Gurugram, Haryana, India · On-site

  • Contact Journey
  • Developed in house SDKs over spark streaming to ingest click stream data of customers from various retail markets
  • Worked on real time basket generation for customers based on there past activity on the platform .
  • Managed Data platform
  • Lead team of 4 engineers to improve data quality of customers across products .
ScalaPythonKibanaElasticsearchApache KafkaHadoop+2

Guavus

Software Engineer Data Platform

Dec 2013May 2016 · 2 yrs 5 mos · New Delhi Area, India · On-site

  • Marketing Reflex (Scala, Spark,python)
  • Was part of the core team, designed aggregation module
  • Integrated platform libs as standard functions
  • Created high tps adaptors using Python and Scala
  • to create production similar data to facilitate product development and testing task
  • Debugging HDFS issues
  • Helped setup distcp to legacy hdfs from hadoop 2.0
  • Created Utilities to efficiently copy data across nodes using Spark
ScalaApache OozieApache Spark StreamingYarnPython (Programming Language)kafka+3

Education

Delhi University

Bachelor of Engineering - BE — Computer Science

Jun 2009Jun 2013

Stackforce found 100+ more professionals with Data Engineering & Python

Explore similar profiles based on matching skills and experience