Jan 2020 – Sep 2023 · 3 yrs 8 mos · Bangalore India · Hybrid

• Smart Forecasting was a unified homegrown Demand Forecast platform for Walmart Stores and eComm across multiple countries. Demand forecasting is a core function of supply chain driving assortment & modular planning, replenishment, fulfilment and transportation. It uses machine learning algorithms to capture sales trends and generate improved forecasts, which further helps in improving customer experience, sale, optimizing operational cost and wastage to the tune of billions of dollars.

Aug 2017 – Jan 2020 · 2 yrs 5 mos

• Leading team to build Big data platform for enterprise data in AWS.
• Tech Stack:
• a) EMR, EC2, Spark, Hive, Sqoop, Athena, Service Catalog, RDS...
• b) S3, Dynamo DB, Hbase, Redshift & Redshift Spectrum
• c) Pyspark, Python, Java, Terraform

Aug 2013 – Jul 2017 · 3 yrs 11 mos

• Working, as Senior data engineer to data engineering Lead, responsible for Architecture design, development and leading end-to-end implementation of various petabyte scale projects on Big Data platform using Technologies in (Hadoop Ecosystem, MPP Netezza, Vertica) and Enterpise Data Warehouse.
• Some of my work:
• Led Architecture design and development of Omniture ClickStream Data processing on Hadoop cluster. This framework provides metadata driven capabilities to process Clickstream data on hourly/daily basis.
• Just after joining, led engineering team to provide end-to-end engineering support for 2 consecutive tax years TY10 & TY11 for critical product - Turbo Tax.
• Responsible for on boarding (Data-In & Data-Out) all product's Clickstream data to Intuit Analytical Cloud (IAC) - Big Data Hadoop cluster using PIG, Hive, Oozie, Hbase, Sqoop and few home grown solutions to analyse customer user behavior, Evaluate A/B testing, Campaign, Referrers, Conversion funnel ...
• Led 12-in-12 organization wide initiative to bring all data (ENT & UED) to Intuit Hadoop data lake - IAC.
• Led effort to adapt Agile development methodologies within the data team. Practicing agile over 4 years. A certified Agile Scrum Master and Agile Coach.
• Planned and managed Operation support transitioning to Ops team, bring them up to the speed.
• "Win-Together" mindset: Responsible for running bi-monthly Learn-share-Learn session only for engineers to discuss about new technology & project learnings.
• Developed multiple frameworks in python like HcatLoader, FileManager, Survey Data Integrator etc...

Mar 2011 – Jul 2013 · 2 yrs 4 mos

• During this period, worked on various projects related to design and development of Data frameworks for Data-In, Data Processing and Data-Out for Web Analytics (Omniture Clickstream data )on MPP Netezza and then migration of Netezza processing to Hadoop cluster for Intuit products like TruboTax, Mint, Quickbooks etc...
• Please refer above section for more details.

Nov 2010 – Mar 2011 · 4 mos

• Over 4 years, worked in UK for one of the largest telecom provider - EverythingEverywhere (previously : Orange ) for their Mobile, Home and CARS Enterprise Data Warehouse solutions using AbInitio ETL tool, UNIX Scripting, MPP Netezza & Business Objects for Batch and Continuos data (Near Realtime) processing. The complete Enterprise Data Warehouse was hosted on Netezza Performance Server (NPS), storing 100+ TB data sourced from hundreds of internal and external sources including XMLs.
• Roles and Responsibilities in different locations and time frame:
• Led offshore development team to understand Orange source systems and EDW solutions, bi-Monthly EDW release and code management.
• Mentoring team on technical deliverables like defining/preparing Scope of LLD, HLD, Scope of Work (SOW), Purchase Orders (PO), Team collaboration with QA, L2 and L3 support.
• Point of contact for ETL governance on the Data Warehouse: writing and reviewing ETL designs and code, and guiding other developers.
• Helping Talent Acquisition team for hiring people in Dev/QA/Support team.
• Initiated POC for Building reporting solution on MIS (THBS internal warehouse) using Open source tool like Talend,Pentaho, Jasper etc... for HR and Finance Team.

Feb 2008 – Oct 2010 · 2 yrs 8 mos

• Responsible for collaborating with Orange Business analysts and designers, to bid for the projects, negotiate on Project pricing, plan and timelines
• SPOC for understanding business requirement, working with teams for impact analysis, defining scope of work, preparing project plan, communicating regular updates to stakeholders
• Led the effort to setup onsite and offshore model from scratch for development and quality team by hiring right talent, setting up the process to quickly bring new hires to up to the speed
• Led 4 members team at UK and 25+ members team at Bangalore to manage end-to-end architecture design, development and delivery of complete Mobile and Home data warehouse projects
• Mentoring team to understand requirement, come up with ETL solutions, code/design review etc.
• Coordinating with different source teams, testing team to align, L2 & L3 with DWH release dates
• Driving design & development of complex, business crtitical projects, generic frameworks from UK
• Configuration management for Ab Initio Repository (EME) which involves Tagging, Code promote, Planning for Branch creation to avoid any conflict for future releases
• Providing best practices, standards and guideline followed for better performance, code maintenance and error handling etc. to keep it updated for QA audit
• Providing system improvement proposals and value additions for Awesome Vendor Experience

Oct 2006 – Jan 2008 · 1 yr 3 mos

• Responsible to build good relationship with Orange designers and showcase technical and domain expertise to get more Data projects.
• Led discussion with Orange UK on getting Business requirement, Negotiation on Effort estimate and Release planning etc...
• Collaborate with Orange technical team closely for the design, development, code review, testing cycle (INT/UAT) & release to production for Data projects.
• Identify, discuss to respective business owners and deliver area of improvements, System value adds

Jul 2004 – Sep 2006 · 2 yrs 2 mos · Chennai, India | NY, USA

• This project was end-to-end implementation of Enterprise Data Warehouse for Citibank North America (CBNA) from scratch. About 27 different source system were integrated into the warehouse. During my stay played multiple roles staring with AbInitio Developer, Onsite CoOrdinator and Team Lead.
• Role and Responsibility:
• 1) Worked as onsite coordinator to lead 8 offshore resources to deliver high priority project within stringent timelines, helped team to create better visibility across and securing "STAR TEAM AWARD"
• 2) Direct interaction with CitiBank NA and BearingPoint USA counter part for requirement gathering and design discussion.
• 3) Responsible for understanding requirements, LLD preparation, designing DWH ETL frameworks, code development, testing and review
• 4) Designing and development of ETL framework using AbInitio, Unix and DB2.
• 5) Responsible for test cases and data generation, to help QA and Reporting team
• 6) Involved in performance tuning of AbInitio graphs and ETL framework to meet SLA.

Jun 2003 – Jul 2004 · 1 yr 1 mo · Mumbai, India

• Joined collage campus recruit and got opportunity to work on DWH/BI domain for AllState (US) Insurance company. This was re-engineer project : - 1) Platform Migration of Mainframe assembly language to Abinitio for MAX Canada. 2) AllState EDW enhancements.
• Role and Responsibility:
• 1) Design and Develop Abinitio graph with Error handling and Restartability.
• 2) Convert Assembly Language common program UDFs and AbInitio compatible code
• 3) Unit and Integration testing, retrofitting of the code
• 4) Training within & across team on Abinitio Tool.