Rahul Arram

Software Engineer

Bengaluru, Karnataka, India5 yrs 10 mos experience

Key Highlights

Expert in designing scalable data pipelines.
Strong background in full-stack development.
Proven ability to enhance operational efficiency.

Stackforce AI infers this person is a Data Engineering and Software Development expert with strong full-stack capabilities.

Contact

Skills

Core Skills

Data Pipeline DesignCi/cdDatabase ManagementData IntegrationWeb DevelopmentMicroservicesData EngineeringSoftware Engineering

Other Skills

.NET.NET Framework.netAngularAngularJSApache AirflowApache BeamApache KafkaApache PigApache PySparkApache SparkApache SupersetApplication Programming InterfacesAthenaBigTable

About

I'm a software professional with hands-on knowledge of System Design and Architecture, Data Analytics, and Full-stack development as my core strength. Have designed scalable & optimized data pipelines to handle PetaBytes of data, with Batch & Real Time frequency. Got good exposure on different BigData frameworks (Hadoop, Spark, Hive, Sqoop, Flink, Kafka, Docker), Databases (MySQL, Cassandra, Elastic Search), AWS Services (S3, Lambda, EMR, Glue, Cloudwatch, Redshift, Athena), Dashboarding Tools (Grafana, Kibana, QuickSight, DataDog, Data Studio), Monitoring Tools (Airflow), Web Development (HTML, CSS, Play, Django, Rest API, JavaScript, Ajax, JQuery), Good command over programming languages (Python, Java, Scala, Shell Scripting) and strong Data Structures & Algorithm fundamentals. I believe anything is possible. I see opportunity when others see impossibility. I take risks. I'm focused. I see problems and challenges as opportunities for growth. I take flying leaps into the unknown. I believe that if you never dream you can never achieve success. I'm an avid reader, a fitness freak, and definitely not a quitter.

Experience

5 yrs 10 mos

Total Experience

1 yr 5 mos

Average Tenure

1 yr 5 mos

Current Experience

Tesco

Software Development Engineer 2

Jan 2025 – Present · 1 yr 5 mos · Greater Bengaluru Area

⌬ Designed and implemented a real-time Bronze → Silver data pipeline using Apache Beam, integrating Great Expectations for data quality validation and OpenLineage for lineage tracking, ensuring governance and auditability in a private cloud environment.
⌬ Refactored HDL(History Data Layer) into a scalable feature store leveraging Iceberg and metadata-driven orchestration, enabling versioning, incremental refresh, and retrospective data rebuilds to support low-latency analytics and machine learning use cases.
⌬ Standardized CI/CD with a Jenkins Shared Library, adding governance, observability (DORA), reliability (fail‑fast validation, hardened tagging), and flexibility (module builds, multi‑region params, post‑deploy hooks), plus Python packaging fixes.

Apache BeamGreat ExpectationsOpenLineageIcebergJenkinsPython+2

Wayfair

Data Reliability Engineer

Oct 2023 – Jan 2025 · 1 yr 3 mos · Greater Bengaluru Area · On-site

⌬ Designed and implemented a robust Database Observer service, delivering actionable metrics for data decoupling and enhanced database management, positively impacting operational efficiency and strategic decision-making.
⌬ Designed and developed StreamGoblin from scratch, an orchestrator-agnostic dependency management system leveraging Google Pub/Sub and BigTable to streamline cross-DAG pipeline dependencies and enhance scalability.
⌬ Orchestrated the seamless integration and evolution of analytics ecosystems, leveraging Looker, Looker Studio, and Connected Sheets to empower data-driven decision-making and collaborative insights across teams.

Database ObserverGoogle Pub/SubBigTableLookerLooker StudioDatabase Management+1

Turtlemint

Senior Data Engineer

Dec 2020 – Oct 2023 · 2 yrs 10 mos · Goa, India · On-site

⌬ Designed and created a Data pipeline for sending real-time email notifications to all stakeholders abt the monthly and yearly business of their teams. Extensively worked on Athena, Redis, Python.
⌬ Revamped complete CRM (Customer Relationship Module) with the latest features using React js, Redux, Django(Rest) frameworks. Optimized the page load time by 60%.
⌬ Worked on apache PySpark and Kafka in building a robust automated Notification Pipeline. Optimized pyspark SQL queries and written unit test cases resulted in the great fault-tolerance system
⌬ Worked on Insights Analytical tool which picks data from S3 and performing operations mentioned in data pipeline and finally plotting data on the frontend using Django AdminLTE relentlessly.

AthenaRedisPythonReactDjangoData Pipeline Design+1

Airlearn (acquired by teachmint)

Founding Software Engineer

Aug 2020 – Dec 2020 · 4 mos · Noida, Uttar Pradesh, India · On-site

⌬ Took ownership in building reusable UI components using Reactjs and Redux. Contributed towards backend as well in building microservice architectures by creating REST APIs and performing CRUD operations.
⌬ Built Micro-services using Node js, Elastic search, Mongo DB, React js.
⌬ Took responsibility for product management and smooth delivery of features and updates to Clients. Done research on product market fit for online education.

ReactReduxNode.jsElastic SearchMongoDBWeb Development+1

Hopscotch

Software Developer

Feb 2020 – Jul 2020 · 5 mos · Greater Bengaluru Area · On-site

⌬ Created RESTful APIs to implement CRUD operations that made supply-chain more efficient. Used Java, Spring, MySQL extensively.
⌬ Worked in the Data Engineering team. Capture the customer's data and maintain it in the data pipeline. Perform analytics with Python.
⌬ Worked on cool technologies in frontend like React, Angular, and Redux.

JavaSpringMySQLReactAngularWeb Development+1

Manhattan associates

Software Engineer

Jun 2019 – Jan 2020 · 7 mos · Greater Bengaluru Area · On-site

⌬ Contributed to the Warehouse Management System(Billing) product team to design & deliver new product features across the complete Warehouse Life cycle using .NET(EF), Angular, Ionic, C#.
⌬ Responsible for smooth product migration for customers through the integration of new product-features without disruptive existing functionality and database migration.
⌬ Collaborated with other R&D teams(SCALE) to implement future enhancements that improved the client's business for various high load distribution centers during peak sessions.
⌬ Developing the required modification/module for clients with Agile. Customizing UI screen.
⌬ Issue Resolution and bug fixing. Preparing Tech Designing and Code review.Involved in Unit Testing.

.NETAngularIonicC#Web DevelopmentSoftware Engineering