Manju Madhav

Data Engineer

Bengaluru, Karnataka, India11 yrs 7 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Over 11 years of experience in data engineering.
Led cross-functional teams at Amazon to build scalable data solutions.
Expert in AWS technologies for data processing and analytics.

Stackforce AI infers this person is a Data Engineering leader in E-commerce with expertise in scalable data solutions.

Contact

manjumadhav93@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringLeadershipAnalyticsSoftware Development

Other Skills

AWSAmazon RedshiftAmazon Web Services (AWS)Analytical SkillsBig DataBusiness InsightsBusiness IntelligenceBusiness RequirementsCCommunicationCustomer AnalysisDACData AnalysisData AnalyticsData Architecture

About

Data Engineering leader with 11+ years of experience in building highly scalable data platforms/teams, delivering end-to-end Big Data Analytics, Data Warehouse and BI systems & creatively solve complex problems. I have a strong background in building and managing end-to-end data solutions that drive business intelligence and operational insights. Over the course of my career, I have worked extensively in designing, implementing, and scaling data platforms that support batch and realtime data ingestion for AI/ML and analytics needs. In my current role at Amazon, I lead a team of data engineers, business intelligence engineers, and support engineers to develop and maintain large-scale data lakes, data warehouses, and reporting infrastructures, leveraging AWS cloud technologies. I have extensive experience in working with distributed systems, data warehousing, and orchestration tools, using technologies such as AWS (EMR, Glue, Redshift, S3), Scala Spark, and PySpark. Additionally, I am skilled in data modelling which involves building logical data models and database schemas to support Machine Learning, business intelligence and reporting usecases.

Experience

11 yrs 7 mos

Total Experience

3 yrs 10 mos

Average Tenure

7 yrs 1 mo

Current Experience

Amazon

4 roles

Data Engineering Manager

Promoted

Jul 2023 – Present · 2 yrs 11 mos · Bengaluru, Karnataka, India · On-site

Leading a cross-functional team of 10+ engineers, including Data Engineers, Business Intelligence Engineers, and Support Engineers, to build data and analytics infrastructure that caters to the business requirements of an organization with 3.5K+ users.
Define the overall data vision and develop a comprehensive data platform architecture for the Amazon Pricing organization to support analytics and AI/ML use cases. This includes managing data ingestion, processing, and storage from various heterogeneous sources to the data lake, as well as facilitating business reporting and generating actionable insights.
Drive product vision, strategy, and execution of self-service analytics products, enabling users (Product Managers, Program and Operational leaders) to interact with data without technical barriers.
Collaborate with Product, Operations, and Data Science teams to create unified data models that address specific use cases, while establishing a data roadmap to influence business strategy.
Lead the analytics roadmap for the Amazon Pricing organization, providing insights into Amazon's selection and pricing strategy, as well as its market positioning.
Drive organisational growth by hiring, coaching, and mentoring junior Data and Business Intelligence engineers, while scaling self-organizing, loosely coupled, yet highly aligned data teams.

LeadershipSoftware DevelopmentData Engineering

Senior Data Engineer

Dec 2022 – Present · 3 yrs 6 mos · Bengaluru, Karnataka, India · On-site

Developed a suite of data applications, including a query repository that standardised and crowdsourced SQL queries to reduce duplication efforts by business analysts, an automated data catalog that facilitates data discovery, and a data quality framework that identifies anomalies and ensures data integrity.
Conceptualised and assisted in developing a data querying platform that retrieves data from an AWS S3 data lake using an intuitive drag-and-drop UI, allowing non-technical users to interact with data without the need for SQL or Python skills.
Worked on designing a conversational chatbot using AWS Lex, allowing users to interact with the system through natural language prompts, which enables self-service capabilities. Usecases included a) Definition of business keywords b) Debugging & Resolution of commonly identified errors c) Fetch Buisness metrics d) Integration with wide range of Amazon tools in a single place.

Software DevelopmentData Engineering

Data Engineer II

Promoted

Jul 2020 – Nov 2022 · 2 yrs 4 mos · Bengaluru, Karnataka, India · On-site

Designed and developed the Amazon Pricing Datalake which processes 35TB+ data on daily basis utilising AWS services (EMR, Glue, Lambda, Redshift, S3, ES) and orchestration tools (AWS Step Function, Data Pipeline, EventBridge).
Developed Spark applications using PySpark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats to meet operational needs.
Revamped data ingestion into Data Warehouse which previously was sourcing data from AWS DDB and RDS via a batch process to a near real-time solution which reduced data processing times by 40% and AWS cost by 35%.
Developed unified datasets to support a wide range of downstream use cases, including operational data needs, business reporting, and integration with the ML feature store.

Data Engineering

Data Engineer I

Mar 2019 – Jun 2020 · 1 yr 3 mos · Bengaluru, Karnataka, India · On-site

Designed scalable data model in Amazon Redshift to measure Amazon pricing metrics for business intelligence and reporting needs.
Standardised datasets and automated reporting for Weekly and Monthly Business Reviews, streamlining previously manual and ad-hoc processes.
Performed complex data analysis leveraging large datasets and statistical techniques to uncover trends and data-driven making.

Data Engineering

Oracle

Member Of Technical Staff

Jul 2017 – Feb 2019 · 1 yr 7 mos · Bengaluru, Karnataka, India · On-site

Played a key role in developing the OTBI (Oracle Transaction Business Intelligence) HCM (Human Capital Management) module, a real-time self-service reporting solution built on top of Oracle Fusion Applications. Focused on creating subject areas centered on employee check-ins and absences within the HCM domain, empowering HR leaders to effectively monitor workforce attendance and optimize resource allocation.
Designed and implemented a predictive model to forecast absence trends, significantly enhancing organisational planning and resource management by delivering actionable insights into potential staffing shortages.

Data Engineering

Teksystems

Software Engineer

Jul 2014 – Jun 2017 · 2 yrs 11 mos · Hyderabad, Telangana, India · On-site

In my role, I worked on design and development of logical and physical data models using star and snowflake schemas as part of OBIA 7.9.6.4 SCM and Financial module implementation.
Developed end-to-end ETL workflows with Informatica Power Center which involved creating complex data transformations and loading the data into Oracle 11g Database.
Developed the semantic layer in OBIEE and created financial and supply chain subject areas in the RPD by applying Kimball data modelling techniques.Additionally implemented object-level and row-level security to ensure users had access to their dedicated roles.
Worked on optimising ETL processes and queries for efficient handling of large volumes and collaborated with stakeholders to ensure the OBIA Finance and SCM modules aligned with their business goals, delivering actionable insights.

Software Development