sandeep v

Software Engineer

Bengaluru, Karnataka, India15 yrs 5 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Over 5 years of experience in Big Data technologies.
Expert in designing scalable data ingestion pipelines.
IBM certified professional in InfoSphere DataStage.

Stackforce AI infers this person is a Big Data Infrastructure Engineer with expertise in data ingestion and site reliability.

Contact

Skills

Core Skills

Site Reliability EngineeringScalabilityData IngestionData Management

Other Skills

Agile MethodologiesApache PigAppworxAutosysData IntegrationDatabasesETLHBaseHadoopHiveK8sKafkaMapReduceMongoDBMySQL

About

• 5+ year Experience in Big Data, Enterprise Data warehouse and hadoop technologies. • Experienced in Application Design and Development, Data Migration and data transformations. • Experienced in automation/building tool for operation efficiency. • Experience in maintaining pipelines which generates data from various data ingestion flows.Troubleshoot and tune performance issues. • IBM certified professional Info sphere, Datastage 7.5; Developed inbound/outbound,inbound,outbound interfaces which included complex transformations ,business logic. Data : Informatica,Datastage,Teradata,Oracle,Hadoop, Pig, Hive, HBase, Spark, Kafka and MySql Concepts : Data Warehouse, Big Data, Data Ingestion framework Big Data Visualization tools :Kibana, Microstrategy Scripting :Python, Shell scripting,Java

Experience

4 roles

Senior Staff Software Engineer

Promoted

Mar 2025 – Present · 1 yr

Led the Data Infrastructure Site Reliability team at LinkedIn, utilizing Python, K8s, Hadoop, Spark, and related technologies.
Implemented scalable solutions to ensure high availability and reliability of data infrastructure systems.
Collaborated with cross-functional teams to optimize performance and efficiency of data processing pipelines.

PythonK8sHadoopSparkSite Reliability EngineeringScalability

Staff SiteReliability Engineer

Sep 2020 – Mar 2025 · 4 yrs 6 mos

Senior Site Reliability Engineer

Mar 2017 – Sep 2020 · 3 yrs 6 mos

Data Service Engineer

Nov 2015 – Mar 2017 · 1 yr 4 mos

Part of Data Services team who manages higly scalable and massive data ingestion data pipeline of LinkedIn consuming data from Kafka, Oracle, MySQL, NoSQL, DataBus(real-time change capturestem) & Third party vendors. This team is also responsible for handling data logistics between multi-colo Hadoop clusters with strict SLA’s in place using distcp technology . Apart from operating and managing data at LinkedIn, this team also builds top notch tools that help in Hadoop capacity planning in terms of computation & storage, alerting, monitoring & data SLA's.
Experience in building and managing data ingetion pipelines from various data sources to HDFS which include Salesforce(Gobblin),ODS(Lumos),Streaming(Kafka),Espresso(Databus), google ads(Gobblin)
Design and Development of an active -active teradata system to ensure the resources are used effectively.
Preparing the DWH system from ground-up cases when data-center builds within short duration.
Responsible for designing and managing distcp process across various hadoop clusters which is tightly SLA driven for making sure data availability for downstream users on time
Responsible for managing LinkedIn’s multi petabyte Hive warehouse which includes dynamically building databases/tables using avro schemas for all the datasets in the Hadoop clusters and setting up a Hive registration process for new tables

KafkaOracleMySQLHadoopdistcpHive+2

Accenture

Senior software Engineer

Jan 2014 – Oct 2015 · 1 yr 9 mos · Bengaluru Area, India

EMC^2 is a product based company with products like Symmetric, centerra, symmetrics, Isilon etc. Big data lake is a big data application within EMC is to match the upcoming demand of customer relation by providing proactive alerts to costumers. The BIG data technology and Agile methodology is used.

Cognizant

Programmer Analyst

Oct 2010 – Jan 2014 · 3 yrs 3 mos · Bengaluru Area, India

IBM certified professional Info sphere Data stage 7.5; Developed inbound/outbound,inbound,outbound interfaces which included complex transformations ,business logic.
Performance tuning on the SQL queries used in the queries and optimization on transformation used to high volume of data.
Developed code reviewer in XML parser to check Client specific coding standard.
Worked on almost all the transformations like xml,java,sql
Involved in various phases of Software Development Life-Cycle as well as Regular Maintenance Job with affective Program tuning
Developed Complex parallel jobs in data stage 7.5 enterprise edition.
Performed reconciliation of data for vendor feeds and based on the results, gaps and fixes were identified and rectified.
Proven strength in problem solving, coordination and analyze stress, time and people effectively
Achievement oriented with excellent people management skills and an ability to manage change with ease