Nov 2020 – Jul 2023 · 2 yrs 8 mos · Bengaluru, Karnataka, India

• 1. Data Ingestion:
• Lead the integration of various data sources into the Data Lake, collaborating with data teams to build efficient ingestion pipelines that capture accurate data.
• 2. Data Transformation:
• Oversee data transformation processes to ensure data quality and scalability. Work closely with data engineers to develop workflows that cleanse and enhance data for analytics and ML.
• 3: Data Lake Management
• Implement governance policies and optimize Data Lake infrastructure for performance and scalability. Ensure data cataloging and metadata practices improve data discoverability and usability.
• 4. Stakeholder Collaboration:
• Partner with cross-functional teams and business leaders to understand data needs, aligning Data Lake
• strategy with organizational goals and facilitating effective communication across technical and non-
• technical teams.
• 5. Analytics and ML Support:
• Support reporting and ML initiatives by providing access to curated datasets and infrastructure. Collaborate with analysts to maintain reporting frameworks and visualization tools that drive data-driven insights.

Oct 2019 – Nov 2020 · 1 yr 1 mo · Bengaluru, Karnataka, India

• Key Responsibilities:
• 1. Data Ingestion:
• Oversee the ingestion process of diverse data sources into the Data Lake.
• Collaborate with data engineers and data scientists to identify, acquire, and onboard relevant data from internal and external sources.
• Implement efficient data ingestion pipelines to ensure timely and accurate data capture.
• 2. Data Transformation:
• Design and implement data transformation processes to cleanse, validate, and enhance data within the Data Lake.
• Work closely with data engineers and data analysts to develop scalable and efficient data transformation workflows.
• Ensure data quality and integrity throughout the transformation process.
• 3. Data Lake Management:
• Develop and enforce data governance policies and best practices for the Data Lake.
• Establish and maintain data cataloging and metadata management practices to enhance data discoverability and usability.
• Monitor and optimize the performance and scalability of the Data Lake infrastructure.
• 4. Collaboration and Stakeholder Management:
• Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and business stakeholders, to understand their data requirements.
• Work closely with business leaders and executives to align the Data Lake strategy with organizational goals and objectives.
• Act as a liaison between technical and non-technical teams to bridge the gap and ensure effective communication.
• 5. Reporting Analytics and ML Support:
• Support reporting analytics initiatives by providing access to curated datasets within the Data Lake.
• Collaborate with data analysts to develop and maintain reporting frameworks and data visualization tools.
• Facilitate the integration of ML platforms by providing the necessary data and infrastructure support.

Nov 2017 – Sep 2019 · 1 yr 10 mos · Bengaluru Area, India

• DB event (change data capture) replication from RDBMS to Hive (Data warehouse system in Hadoop eco system).
• Technologies
• ===========
• AWS web services,Kafka, Hadoop, Spark Scala, WebServices(REST)
• Data pipeline auditing framework
• Technologies
• ===========
• Kafka, Spark Streaming, HBase, Splunk, WebServices(REST)

Jan 2017 – Nov 2017 · 10 mos · Bengaluru Area, India

• Responsibilities include mentoring juniors via architectural implementations/enhancements on various Data systems and also being front face of Apache Falcon and Data Reporting Systems @ Inmobi.

Aug 2013 – Dec 2016 · 3 yrs 4 mos · Bengaluru Area, India

• Working on building entire EDW/BI product stack
• Logical and physical data modeling/design
• ETL process design and implementation
• High Availability and Scaling of product
• Performance tuning

Nov 2016 – Present · 9 yrs 6 mos

• Have worked on :
• User Extensions,Falcon Shell, BackLogMetricService, Monitoring Service ,LogMoverService, Persistance Store in Falcon along with many enhancements
• List of my falcon commits :
• https://goo.gl/Qm3246

Feb 2012 – Aug 2013 · 1 yr 6 mos · Gurgaon, India

• Developing BI reports for enhancements/projects from detailed design documents utilizing Microstrategy v9.Functional Consulting with different departments and resolve their business needs in form of reports required for strategic decisions.
• Developing ETL programs for enhancements/projects from detailed design specifications utilizing PLSQL and Informatica v9.
• Conducting root cause analysis and resolve production problems and data issues as necessary. Perform SQL tuning and serve as the primary escalation point for complex performance and database issues.
• Acting as a bridge between Business Users, Business Analysts, Data Analysts, Data Architects, ETL & BI Developers by getting their requirement transformed into technology.
• Database designing for data warehousing.
• Server administration.

Aug 2010 – Mar 2012 · 1 yr 7 mos

• Worked as a part of the suport team on various client projects
• Responsible for developing the ETL interface between Servigistics and client systems
• Responsible for custom code development
• Responsible for workflow scheduling and error handling
• Responsible for project documentation