Vijayant Soni — Senior Software Engineer

DON'T send me a connection request if you encourage instagram posts on LinkedIn by liking, sharing etc. Eng Blogs: https://www.uber.com/en-IN/blog/spark-analysers-catching-anti-patterns-in-spark-apps/ Data Platform - Realtime Resource Optimization Systems - Recommendation Systems - Near Realtime Fraud Detection Systems - Realtime Data Ingestion Pipelines - Post-Data-Ingestion Flows - ML / Data Science Feature Preparation - GDPR / CCPA Compliant Data Systems - Hooks and Operators for Apache Airflow - Data Anomaly Detection tools - Deployment Framework for ML Models and Data Science workflows - Setting up Big Data & ML repositories from scratch - ETL Orchestration Frameworks - Realtime Notification System Developer Productivity - Evaluating and adopting new Git workflows - CI / CD for Apache Spark (Scala & Pyspark) Open Source Contributions - Apache Airflow · Adding AWS ElastiCache Hook · https://github.com/apache/airflow/pull/8701 - Apache Airflow · Enhance AWS EC2 Hook · https://github.com/apache/airflow/pull/9011 - Pandas · Adding unit test · https://github.com/pandas-dev/pandas/pull/29211 - Dask · Reusing code for assert_eq util method · https://github.com/dask/dask/pull/5496

Stackforce AI infers this person is a Data Engineering expert with a focus on real-time analytics and open-source contributions.

Experience: 10 yrs 7 mos