Sandeep Devaiah

CTO

Bengaluru, Karnataka, India16 yrs 1 mo experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Led modernization of LinkedIn's data platform.
  • Expert in managing large datasets and ETL processes.
  • Proven track record in data governance and optimization.
Stackforce AI infers this person is a Data Engineering expert with a focus on Big Data solutions and technical architecture.

Contact

Skills

Core Skills

Data EngineeringData GovernanceBig DataData AnalyticsTechnical ArchitectureProject Management

Other Skills

Data Platform ModernizationHadoopSparkAirflowGovernanceOptimizationData IntegrationETLHiveBig Data SolutionsData ModelingSQLMicrostrategyTableauDatabase Management

About

An astute go getter ,aspiring leader ,performing a role of an IC and an excellent team player having widespread working experience on niche technologies like Hadoop, Datawarehousing . Working on large datasets and exposure to converting some of the complex logics on traditional data ware house to run on the hadoop ecosystem.

Experience

Linkedin

3 roles

Engineering Leader

Promoted

Aug 2022Present · 3 yrs 7 mos · Bengaluru, Karnataka, India

  • Data Platform Modernization & Transformation
  • Spearheaded LinkedIn's data platform modernization, moving hundreds of pipelines to a unified, dbt-based transformation framework (inDBT) on Spark and Hadoop. This significantly improved developer velocity, governance, and standardization.
  • Defined the long-term technical vision for scalable, declarative data authoring, leveraging Airflow for orchestration to build a sustainable foundation for 10,000+ production data workflows.
  • Efficiency, Governance, & Cross-Functional Leadership
  • Drove company-wide compute and storage efficiency programs, analyzing Spark/Hadoop workloads and implementing optimization that achieved multi-million dollar annual CAPEX savings via compute reduction, compaction, and retention.
  • Partnered across Infra, UMP, CPS, and GGW to establish end-to-end lifecycle governance—from authoring to storage—aligning lineage and retention under a single strategy, including Pinot for real-time analytics.
  • Influenced the design and rollout of next-gen infrastructure (e.g., Nimbus orchestration, Hydrofoil compute), ensuring platform readiness for critical enterprise initiatives using Airflow and Iceberg standards.
  • Adoption, Enablement, & Performance Culture
  • Built organizational alignment and adoption at scale, leading migration playbooks and hands-on enablement for 200+ engineers/analysts to successfully adopt dbt, Iceberg, and Airflow as core development standards.
  • Established a performance/observability culture by launching data quality, cost visibility, and efficiency dashboards (leveraging Jupyter Notebooks) that transformed platform governance and usage measurement.
  • Mentored and guided multiple platform teams, shaping architectural decisions, establishing reusable design patterns, and promoting a long-term culture of craftsmanship and innovation.
Data Platform ModernizationHadoopSparkAirflowGovernanceOptimization+2

Data platforms lead /Staff Engineer

Dec 2019May 2021 · 1 yr 5 mos

  • Enable business analytics with powerful yet easy-to-use data.
  • Advance the data integration platform and methodology in the era of Big Data.
  • High-performance data movement solution
  • GDPR infrastructure to adhere to policies
  • ETL tooling and performance tuning best practice
  • Working on Hadoop, Hive. Mainly Handling large data set(in terabytes) and writing MR jobs and hive queries to do Data analysis.
  • Big Data Solutions, Data processing on Hadoop workflows, Analytics & metrics reporting tools & tech: Spark, Hive, Java, Hadoop, Azkaban, Apache Velocity
Data IntegrationETLHadoopHiveBig Data SolutionsData Engineering+1

Software Engineer- Big Data Analytics and Infrastructure

Jul 2013Dec 2019 · 6 yrs 5 mos

  • .Working on bringing large data sets from different sources to Data warehouse.
  • .Working closely with various teams like sales , operations and helping these teams to build great insights dashboard where the data points act as a catalyst for the sales team to sell the products.
  • .ETL'ing Data using Pig scripts & Hive.
  • Proficient in Data modeling, SQL scripts and Teradata Utilities.
  • .Proficient in gathering requirements and building a use case that will benefit the users and displaying the data in the most effective manner including tools like Microstrategy and Tableau .
  • .A good understanding of basic shell scripting that is required for day to day activities
  • .Exposure to niche technology company tools like salesforce ,Real Time Ad exchange and overall Ads related domain
  • .Design and Development of an active -active teradata system to ensure the resources are used effectively.
ETLData ModelingSQLMicrostrategyTableauData Engineering+1

Tesco

Technical Architect

Jul 2007Aug 2013 · 6 yrs 1 mo · Welwyn Garden City, England, United Kingdom

  • Managed a team of 5 -6 developers driving optimised solutions
  • Established as a Technical Architect in providing solutions and improving business processes and involved in the functional business processes decision making.
  • Excelled in developing reports for top management on dashboards,Widgets/Flash,Documents.
  • High degree of skill in database commands, Backup, and Teradata utilities such as BTEQ, Fast/MultiLoad, FastExport, , Arcmain, SQL Assistant.
  • Focused performance in high-pressure situations with innate strengths in identifying and developing automated measures which minimize recurring activities of administration while constantly seeking new challenges.
  • Proven capabilities in strong problem solving, designing innovative strategies and implementing cost rationalization measures to enhance operational efficiency to generate desired resonance across the management.
  • Passionate about pursuing a long term career in Data Warehousing with a desire to exceed expectations.
  • Expertise in complete Project Life Cycle from Requirement analysis, Design, Build, Testing, Implement & Support.
  • Technically savvy, versatile, adaptable and a quick learner with excellent personnel-management, leadership skills, time management with keen attention to detail and highly self motivated.
  • Spent over 18 months in UK to gather requirements and implement solutions for the reporting stream.
  • Expertise developed in areas of Project implementation, Transitions, Project management, Client interaction, Team management and Process Improvements.
  • Part of the Onsite Rapid action team for a year and was a natural go to person to give technical solutions for critical business and front end issues thereby appreciated by the IT director
Technical ArchitectureDatabase ManagementProject ManagementTeam Management

Education

Birla Institute of Technology and Science, Pilani

Master of Technology - MTech

Visheswaraya Institute of Technology

Bachelor of Engineering (BE) — Engineering

Jan 2003Jan 2007

Pre University St Josephs Arts and Science College

12th

Jan 2001Jan 2003

High School Presidency School

10th

Stackforce found 100+ more professionals with Data Engineering & Data Governance

Explore similar profiles based on matching skills and experience