Wed Prakash

Software Engineer

Bengaluru, Karnataka, India9 yrs 7 mos experience
Most Likely To Switch

Key Highlights

  • Over seven years of experience in data engineering.
  • Expert in designing real-time and batch-processing data solutions.
  • Proficient in cloud platforms and big data processing.
Stackforce AI infers this person is a Data Engineer specializing in SaaS and Fintech solutions.

Contact

Skills

Core Skills

Data EngineeringData ArchitectureDatabase Design

Other Skills

AWS GlueAWS LambdaAWS SageMakerAWS Step FunctionsAgile EnvironmentAmazon ECSAmazon Elastic MapReduce (EMR)Amazon RedshiftAmazon S3Apache AirflowApache KafkaApache SparkApache Spark StreamingAthenaBig Data

About

As a Data Engineer with over seven years of experience, I have successfully designed and implemented distributed, real-time, and batch-processing data solutions for various businesses. I have a goal-oriented approach that allows me to understand business problems and create systems to improve functionality. I have also gained proficiency in cloud platforms, data warehouse design, ETL development, programming languages, and big data processing with Spark. I am the founding Data Engineer at SALT - mysaltapp, where I built the data infrastructure from scratch. I developed a solution to ingest events generated by our application to a data lake, which improved reporting and analytics. I also implemented MLOps to better orchestrate and deploy data models for Natural Language Processing. Additionally, I developed a high throughput, fault-tolerant data pipeline to ingest data from different OLTP databases to the data warehouse (Redshift) in real-time, with below 120 seconds. In my previous roles, I have also delivered impactful projects, such as re-architecting an infinitely growing data system, processing real-time transaction data, and building an online/offline feature store. My ability to work effectively in self-motivated and collaborative settings makes me a valuable asset to any team.

Experience

Stellantis

Senior Data Engineer

Apr 2024Present · 1 yr 11 mos · Bengaluru, Karnataka, India

Salt - mysaltapp

Data Engineer

Apr 2022Apr 2024 · 2 yrs · Bangalore Urban, Karnataka, India

  • Event-Driven Data Lake Architecture:
  • Engineered a cutting-edge solution to capture application-generated events.
  • Directed the seamless flow of these events into the Data Lake, amplifying reporting and analytics
  • capabilities.
  • Collaborated on ETL tasks to ensure data integrity and maintain pipeline stability.
  • ML Pipeline Optimization:
  • Designed and developed an ML Pipeline for automatic deployment of Machine Learning Models in
  • Amazon SageMaker.
  • Developed workflow that autonomously retrains models with previous day's data. Eliminated manual intervention, ensured streamlined and efficient deployment process.
  • Real-time Financial Data Ingestion:
  • Developed a dynamic Data Pipeline for real-time ingestion of financial transaction details from
  • banks and Financial Information Providers (FIP) using the Account Aggregator Framework.
  • Cloud Environment Enhancement:
  • Seamlessly incorporated CDK into our tech stack, contributing to the creation of a robust and
  • scalable environment for efficient cloud-based applications.
  • Strategic AWS Multi-Account Architecture: Elevating Governance:
  • Architected comprehensive AWS multi-account setup to segregate workloads and distinct
  • business units into separate AWS accounts to enhance governance, strengthen security, and
  • organizes role-based access in a more efficient and structured manner.
Data WarehousingRelational DatabasesKafka StreamsDatabasesAWS GlueAmazon ECS+24

Slice

Data Engineer

Aug 2021Mar 2022 · 7 mos · Bengaluru, Karnataka, India

  • Scaling to Peaks:
  • Engineered a robust Data Platform Solution to handle millions of user device data in real time using
  • Spark.
  • Managed a staggering peak of 1.2TB data per day, ensuring seamless processing and accessibility.
  • Real-time Metrics for Machine Learning:
  • Enabled instantaneous access to real-time metrics, empowering Machine Learning and Data
  • Analytics Pipelines.
  • Enhanced the ability to make predictions in real-time, revolutionizing our approach to the credit limit
  • approval.
  • Reducing Business Response Time:
  • The integration of real-time metrics resulted in a significant reduction in business response time
  • for credit limit approvals.
  • Re-Architecture and Performance Tuning:
  • Undertook a strategic re-architecture and performance tuning to prevent the menace of infinite
  • data growth.
  • Achieved a remarkable balance, reducing overall costs while enhancing the system's performance.
  • Fraud Prevention Through Real-time Transaction Processing:
  • Engineered real-time Fraud Detection system capable of swiftly identifying and flagging any
  • anomalous activity in user card transactions. Leveraged Spark Streaming to process real-time data
  • streams, updating and creating user-level metrics to effectively flag anomalies as they occur
Data WarehousingRelational DatabasesKafka StreamsDatabasesAWS GlueETL+23

Ezetap mobile solutions pvt. ltd

Data Engineer

Apr 2019Sep 2021 · 2 yrs 5 mos · Bangalore Urban, Karnataka, India

  • Real-time Data Ingestion to Redshift:
  • Designed and developed a high-performance Data Pipeline (ETL) to ingest data from various
  • sources to Redshift.
  • Managed a peak of 50 GB of data per hour in real-time and batch, catering to analytical
  • requirements.
  • Resulted in reduced query latency and empowered cross-joining of data, enhancing day-to-day
  • reporting efficiency.
  • Dynamic Data Platform with Schema Agility:
  • Engineered a Data Platform solution with automatic schema detection for real-time schema
  • changes.
  • Ensured unparalleled agility in adapting to evolving data sources, providing a flexible foundation for
  • dynamic data environments.
  • Streaming Data Pipeline for Analytics and Predictions:
  • Developed a streaming Data Pipeline using Kafka and Spark for real-time and batch processing.
  • Facilitated data analytics, predictions, and anomaly detection, elevating our data-driven decision-
  • making capabilities.
  • Robust Data Platform Architecture:
  • Architected a robust Data Platform for the Data Warehouse (Redshift), streamlining and enhancing
  • data management processes.
  • Unified Data Lake for Seamless Integration:
  • Designed and implemented a Data Platform solution to effortlessly ingest and unify various data
  • types into a dynamic Data Lake.
  • Fostering visualisation and seamless integration, it opened new horizons for data exploration and
  • utilisation.
Data WarehousingRelational DatabasesMySQLKafka StreamsDatabasesHive+22

Informatica

Data Engineer

Oct 2018Apr 2019 · 6 mos · Bengaluru, India

  • Contributed in Informatica Cloud connector Development. Successfully developed Twitter Connector, and done POC for facebook and LinkedIn Connector.
Relational DatabasesDatabasesSQLData EngineeringProblem SolvingCommunication

Tecnotree convergence private limited

Engineer Software

Jul 2016Oct 2018 · 2 yrs 3 mos · India

  • Contributed in Spring boot, Java based web application backend development.
  • Worked in rule engine to dynamically configure business rules.
Relational DatabasesDatabasesSQLDatabase DesignProblem SolvingCommunication+2

Education

Siddaganga Institute Of Technology

Bachelor of Engineering - BE

Jun 2012Jul 2016

Stackforce found 100+ more professionals with Data Engineering & Data Architecture

Explore similar profiles based on matching skills and experience