Vedanth V Baliga — Data Engineer

I’m a Data Engineer at StoneX, a global financial services firm, with 2 years of experience designing, building, and maintaining end-to-end data systems that power analytics, reporting, and real-time decision-making. My core expertise lies in building scalable data pipelines and architectures using modern tools like Databricks, Apache Spark, and Redpanda. I specialize in implementing Lakehouse architecture using Databricks, where I’ve worked extensively with Delta Lake for reliable storage and Delta Live Tables (DLT) to orchestrate production-grade data pipelines with built-in quality checks, monitoring, and versioning. In addition to Spark-based batch and streaming workloads, I work with Redpanda, a high-performance Kafka-compatible streaming platform, to power low-latency event-driven systems. This enables us to support real-time data ingestion, transformations, and alerts across financial datasets. I use Python and SQL to write clean, modular ETL code, while Power BI is my go-to tool for turning raw data into insightful dashboards for business stakeholders. 🔧 𝐂𝐨𝐫𝐞 𝐓𝐨𝐨𝐥𝐬 & 𝐓𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐢𝐞𝐬: 📌𝐃𝐚𝐭𝐚𝐛𝐫𝐢𝐜𝐤𝐬: Lakehouse architecture, Delta Live Tables, Delta Lake, ML integration 📌𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤 (𝐏𝐲𝐒𝐩𝐚𝐫𝐤): Distributed data processing and transformation 📌𝐑𝐞𝐝𝐩𝐚𝐧𝐝𝐚: High-throughput streaming pipelines 📌𝐏𝐲𝐭𝐡𝐨𝐧: Scripting, transformation logic, API interaction 📌𝐒𝐐𝐋: Data Modeling, querying, and optimization 📌𝐏𝐨𝐰𝐞𝐫 𝐁𝐈: Business intelligence, reporting, interactive dashboards I’m passionate about building data systems that are not just functional, but resilient, observable, and business-aligned. I value clean architecture, data reliability, and continuous learning. Feel free to connect if you're working in data engineering, analytics, or building modern data platforms!

Stackforce AI infers this person is a Fintech Data Engineer specializing in scalable data architectures and real-time analytics.

Location: Bengaluru, Karnataka, India

Experience: 1 yr 9 mos

Skills

Data Engineering
Apache Spark
Machine Learning

Career Highlights

Led development of a major data platform for crypto trading.
Expert in building scalable data pipelines with Databricks.
Strong collaboration with cross-functional business units.

Work Experience

StoneX Group Inc.

Data Engineer II (4 mos)

Data Engineer I (1 yr 5 mos)

Data Engineering Intern (5 mos)

Nokia

NBUC Machine Learning Intern (5 mos)

Belyntic GmbH

Machine Learning Engineer Intern (3 mos)

Omdena

Junior Machine Learning Engineer (1 mo)

ProxMaq

Computer Vision Developer (4 mos)

Skillbasics

YouTube Content Creator (2 mos)

Education

Bachelor's degree at Dayananda Sagar Institutions

Class 12-Intermidiate at Deeksha Center For Learning

ICSE at Clarence Public School

at GEMS Education

Vedanth V Baliga

Data Engineer

Bengaluru, Karnataka, India1 yr 9 mos experience

AI EnabledAI ML Practitioner

Key Highlights

Led development of a major data platform for crypto trading.
Expert in building scalable data pipelines with Databricks.
Strong collaboration with cross-functional business units.

Stackforce AI infers this person is a Fintech Data Engineer specializing in scalable data architectures and real-time analytics.

Contact

Skills

Core Skills

Data EngineeringApache SparkMachine Learning

Other Skills

Azure DatabricksTrading SystemsData ModelingDatabricksPySparkAzure Data Lake StorageRedpanda KafkaPowerBIAzure DevOpsSQLPythonDeep LearningPython (Programming Language)TensorFlowNatural Language Processing (NLP)

About

Experience

1 yr 9 mos

Total Experience

1 yr 9 mos

Average Tenure

1 yr 9 mos

Current Experience

Stonex group inc.

3 roles

Data Engineer II

Jan 2026 – Present · 4 mos · Bengaluru, Karnataka, India · Hybrid

Data Engineer I

Jul 2024 – Dec 2025 · 1 yr 5 mos · Bengaluru, Karnataka, India · Hybrid

𝐏𝐫𝐨𝐣𝐞𝐜𝐭 : 𝐔𝐧𝐢𝐟𝐢𝐞𝐝 𝐃𝐚𝐭𝐚 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦 𝐅𝐨𝐫 𝐒𝐭𝐨𝐧𝐞𝐗 𝐃𝐢𝐠𝐢𝐭𝐚𝐥 𝐋𝐋𝐂
🟦 𝐓𝐞𝐜𝐡 𝐒𝐭𝐚𝐜𝐤
📌 Databricks, PySpark, Azure Data Lake Storage, Redpanda Kafka and PowerBI.
🟦 𝐀𝐜𝐡𝐞𝐢𝐯𝐞𝐦𝐞𝐧𝐭𝐬
📌 Tasked and led the development and deployment of a major data engineering initiative for 𝐒𝐭𝐨𝐧𝐞𝐗 𝐃𝐢𝐠𝐢𝐭𝐚𝐥 𝐋𝐋𝐂, a newly established institutional-grade digital assets platform. This platform now supports institutional crypto trading operations generating over $3 𝐦𝐢𝐥𝐥𝐢𝐨𝐧 𝐢𝐧 𝐭𝐫𝐚𝐝𝐢𝐧𝐠 𝐫𝐞𝐯𝐞𝐧𝐮𝐞 𝐝𝐚𝐢𝐥𝐲 𝐰𝐢𝐭𝐡 𝐡𝐮𝐧𝐝𝐫𝐞𝐝𝐬 𝐨𝐟 𝐭𝐡𝐨𝐮𝐬𝐚𝐧𝐝𝐬 𝐨𝐟 𝐭𝐫𝐚𝐝𝐞𝐬 𝐩𝐥𝐚𝐜𝐞𝐝.
📌 Designed and implemented the Lakehouse architecture using Databricks, structuring raw and curated data layers following the medallion architecture model:
𝐓𝐡𝐢𝐬 𝐢𝐧𝐜𝐥𝐮𝐝𝐞𝐝 𝐝𝐞𝐟𝐢𝐧𝐢𝐧𝐠 𝐚𝐧𝐝 𝐦𝐨𝐝𝐞𝐥𝐢𝐧𝐠 𝐟𝐚𝐜𝐭 𝐚𝐧𝐝 𝐝𝐢𝐦𝐞𝐧𝐬𝐢𝐨𝐧 𝐭𝐚𝐛𝐥𝐞𝐬 𝐟𝐨𝐫 𝐦𝐮𝐥𝐭𝐢𝐩𝐥𝐞 𝐤𝐞𝐲 𝐟𝐢𝐧𝐚𝐧𝐜𝐢𝐚𝐥 𝐝𝐨𝐦𝐚𝐢𝐧𝐬 𝐬𝐮𝐜𝐡 𝐚𝐬 𝐓𝐫𝐚𝐝𝐞𝐬, 𝐏𝐨𝐬𝐢𝐭𝐢𝐨𝐧𝐬, 𝐁𝐚𝐥𝐚𝐧𝐜𝐞𝐬, 𝐚𝐧𝐝 𝐏𝐨𝐬𝐭𝐢𝐧𝐠𝐬 from multiple external systems including Talos Trading and Fireblocks. I collaborated closely with data consumers and analysts to identify business-critical KPIs and data contracts, ensuring high data accuracy and discoverability across the Lakehouse.
📌 Played a central role in building and maintaining ETL pipelines for orchestration, applying schema enforcement, change data capture, and built-in quality checks. This allowed the team to manage pipeline lineage, recovery, and performance with confidence—while supporting continuous delivery of data with near real-time latency.
📌 Collaborated cross-functionally with multiple business units including Risk, Dealing Operations, Compliance, and Finance, acting as the technical point of contact for the data engineering team. My work involved translating complex requirements into scalable, production-grade data solutions.

Apache SparkAzure DatabricksData EngineeringTrading SystemsData Modeling

Data Engineering Intern

Jan 2024 – Jun 2024 · 5 mos · Bengaluru, Karnataka, India · Hybrid

Azure DevOpsAzure DatabricksSQLPython

Nokia

NBUC Machine Learning Intern

Apr 2023 – Sep 2023 · 5 mos · Greater Bengaluru Area · Remote

Deep LearningPython (Programming Language)TensorFlowNatural Language Processing (NLP)

Belyntic gmbh

Machine Learning Engineer Intern

Jan 2023 – Apr 2023 · 3 mos · Berlin, Germany · Remote

𝐎𝐫𝐠𝐚𝐧𝐢𝐳𝐚𝐭𝐢𝐨𝐧 : 𝐎𝐦𝐝𝐞𝐧𝐚-𝐁𝐞𝐥𝐲𝐧𝐭𝐢𝐜
𝐏𝐫𝐨𝐣𝐞𝐜𝐭 : 𝐃𝐞𝐯𝐞𝐥𝐨𝐩𝐢𝐧𝐠 𝐍𝐨𝐯𝐞𝐥 𝐒𝐞𝐥𝐟-𝐚𝐝𝐣𝐮𝐯𝐚𝐧𝐭 𝐕𝐚𝐜𝐜𝐢𝐧𝐞 𝐟𝐨𝐫 𝐏𝐫𝐨𝐠𝐫𝐞𝐬𝐬𝐢𝐯𝐞 𝐌𝐮𝐥𝐭𝐢𝐟𝐨𝐜𝐚𝐥 𝐋𝐞𝐮𝐤𝐨𝐞𝐧𝐜𝐞𝐩𝐡𝐚𝐥𝐨𝐩𝐚𝐭𝐡𝐲

Deep LearningComputer VisionNatural Language Processing (NLP)

Omdena

Junior Machine Learning Engineer

Dec 2022 – Jan 2023 · 1 mo · Marseille, Provence-Alpes-Côte d'Azur, France · Remote

𝐏𝐫𝐨𝐣𝐞𝐜𝐭: 𝐒𝐨𝐜𝐢𝐚𝐥 𝐇𝐚𝐭𝐞 𝐚𝐧𝐝 𝐂𝐲𝐛𝐞𝐫 C𝐫𝐢𝐦𝐞 𝐚𝐧𝐝 𝐎𝐟𝐟𝐞𝐧𝐬𝐢𝐯𝐞 𝐓𝐞𝐱𝐭 𝐃𝐞𝐭𝐞𝐜𝐭𝐢𝐨𝐧 𝐢𝐧 𝐅𝐫𝐞𝐧𝐜𝐡 𝐒𝐨𝐜𝐢𝐚𝐥 𝐍𝐞𝐭𝐰𝐨𝐫𝐤 𝐃𝐚𝐭𝐚
𝐊𝐞𝐲 𝐓𝐚𝐬𝐤𝐬 𝐚𝐧𝐝 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬
(1) Worked on building continuous updating DAG pipelines in Airflow to ingest French Twitter data using the Twitter API integrated with the data flow architecture.
(2) Leveraged RedditAPI and Facebook Graph API to extracts comments from over 100k posts and ingested data to PostgreSQL.
(3) The final dataset consisted of over 50,000 comments and posts in French. I applied various RegEx techniques to clean the dataset. This data was then preprocessed and lemmatized using 4 different parsers utilizing the Spacy Library.
(4) Created User and Developer Docs for the Data Engineering Team specifically for the Data Ingestion scripts.
(5) Research and Implementation of Zero Shot models like BART for auto labelling French Twitter Data with an accuracy of 85% which is commendable because many of these Zero Shot Models were built for English language data.
(6) Developed Apache Hadoop Data Ingestion pipelines for massive and large scale Social Network data.
(7) Implemented Dense Convolution Models with multiple dense layers with an F1 Score of 0.66
(8) Utilized and Implemented DistillBERT models from the HuggingFace Transformers Library on the French dataset augmented and annotated using the Zero Shot BART Approach with accuracy of ~90% and F1 Score of 0.78
(9) Fine Tuned the BERT Models with Pytorch Lightning and built a learning rate scheduler with custom learning rate, pre training stop late and early stopping. This helped the team to calculate an accurate number of epochs to achieve the best performance metrics.
(10) Implemented a variety of custom loss functions from various research papers like DICE, ADAM, Black ADAM and SGD.
(11) Implemented a TensorBoard dashboard and chart to visualize the model outputs and interpret the results.

Machine LearningPyTorchTensorFlowHadoopApache AirflowNatural Language Processing (NLP)+1

Proxmaq

Computer Vision Developer

Oct 2020 – Feb 2021 · 4 mos · Bangalore Urban, Karnataka, India

I am working on a project called ProxVision that aims to build an AI powered Device that would help the blind communicate.
Some of the Technologies that I am working on are:
1. Python Web Scraping using Selenium and Scrappy
2. Data Annotation using Labellimg
3. Object Detection and Image Processing using OpenCV.
Here is the website with complete details of the project:www.prox-gen.com

Skillbasics

YouTube Content Creator

Oct 2020 – Dec 2020 · 2 mos · Remote

I am creating programming tutorial videos for the Skillbasics YouTube Channel with an aim to improve my soft skills and video production knowledge.
Link to the channel: https://www.youtube.com/channel/UCb9AfI-bsXibgECEzyT7Bdw/featured