Ashish Sharma

Senior Software Engineer

Bengaluru, Karnataka, India10 yrs 3 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in Apache Spark and Kubernetes.
Significant contributions to Apache Hive.
Experience in cloud migration and data engineering.

Stackforce AI infers this person is a Cloud Computing and Data Engineering expert with strong skills in Apache technologies.

Contact

Skills

Core Skills

Apache SparkKubernetesGcpHiveApache HiveHadoop

Other Skills

HDFSJavaUDFCachingDataNucleusAzureAzure Data FactoryAnsibleGoLangMySQLRESTful APIsORCAndroid DevelopmentJavaScriptC++

Experience

10 yrs 3 mos

Total Experience

2 yrs 6 mos

Average Tenure

3 yrs 10 mos

Current Experience

Uber

Senior Software Engineer

Jul 2022 – Present · 3 yrs 10 mos · Bangalore Urban, Karnataka, India · On-site

Spark on GCP Iass migration using GCS: Set up Infra in GCP, Build support for idempotent rename using meta file as GCS doesn't support move instead perfrom copy + delete in 2 steps which lead to lot of bugs. Build new Direct File output committer (DFOC) to match the perfromace of spark job using HDFS vs Spark job using GCS. Build Active Active implict spark sql routing by parsing spark sql query in the fly to extract Hive table. Then on the fly check the status of table in given region then decided to run the workload in onprem vs cloud.
Batch Compute (Spark Sql): Set up infra for spark sql like building SDK, beeline support, spark sql support in ETLs. Migration of payload from hive to spark sql. Fill feature gaps like merge small files, bucket table support, group by on complex data. Add support for hiveHash based bucketed hive table read & write support in spark sql. Upgrade spark 3.0 to Spark 3.3.2.
Batch Compute (Hive) 8-member team; Maintain Hive, Build Support for Single Region Compute in HIVE (DR solution). Migrated hive workload to cloud (iass) based on Object Storage Optimise. hive on cloud by building features like Direct File Output Committer, Optimise file in hive, reduce DFS touch points like rename, move, ls etc.

Apache SparkGCPHDFSHiveKubernetesJava

Microsoft

2 roles

Senior Software Engineer

Mar 2022 – Jul 2022 · 4 mos · Bengaluru, Karnataka, India

Hive on Kubernetes (Hive on k8 as azure offering) 3-member team; Provide native support for K8 out of the box in
hive. Develop and scale hive on AKS(azure kubernetes Service) then contribute it back to
Open source.

KubernetesAzureHiveJava

Software Engineer II

Jun 2020 – Mar 2022 · 1 yr 9 mos · Bengaluru, Karnataka, India

Hive on Azure (Hive on HDInsight) 3-member team; Maintain, develop new feature, back port from OSS hive, release
management of HIVE in HDInsight suit of azure

HadoopAzure Data FactoryApache SparkHive

Flipkart

2 roles

Software Development Engineer - 2

Promoted

Jul 2018 – Jun 2020 · 1 yr 11 mos

1. KaaS( Kubernetes as service): 8-member team; Build multiple feature like Cluster federation, On demand custom graph, cni etc. Kubernetes, Ansible, GoLang, MySql, RESTful apis
2. Data Platform (Company wide data warehouse/Platform to store data): 2-member team; Build microservice for automated backup of entire production hadoop cluster data to geographically dislocated backup hadoop cluster. Once click restore of backup data from backup cluster to production cluster.; RESTful apis ,Java ,Hadoop, MySQL, Azkaban.

KubernetesAnsibleGoLangMySQL

Software Development Engineer - 1

Dec 2016 – Jun 2018 · 1 yr 6 mos

1. Data Platform (Company wide data warehouse/Platform to store data): 2-member team; Build feature like JSON text file format to ORC file format. Optimize Hive to support PPD in nested structure schema.; RESTful apis, Java, hadoop, ORC, Hive, hdfs.
2. Login Service (microservice to power login on all system across organisation): 2-member team; Build features like Notifications on certain events, Optimizing cache layer, OTP Login, Login with flipkart, Maintain Service/Database/cache cluster, Multitent System; Java, RESTful apis, dropwizard, MySQL, Aerospike, Couchbase.
3. User Service (microservice to power profile, preference,addresses..etc): 2-member team; Build features like Optimizing cache layer, Build Payment preference, Experiment framework, Maintain Service/Database/cache clusters, Multitent System ; Java, RESTful apis, dropwizard,MySQL, Aerospike, Couchbase.
4. Subscription Service (microservice to power Flipkart First service): 2-member team; Build features like Optimizing cache layer, Experiment framework, Maintain Service/Database/cache clusters, Multitent System; Java, RESTful apis, dropwizard,MySQL, Aerospike, Couchbase.

JavaRESTful APIsHadoopORC

The apache software foundation

Apache Contributor HIVE

Jan 2018 – Apr 2025 · 7 yrs 3 mos

Contributed features like
1. Caching in HMS
2. UDF refactor
3. Hive date api moved from java 1.1 to jave 1.8
3. Security complinace
4. Data datanucleus upgrade
5. constrain api consolidation
6. Export import performance bump
7. Compaction bug fix
https://github.com/apache/hive/commits?author=ashish-kumar-sharma

Apache HiveJavaUDFCachingDataNucleus

Nestaway technologies pvt ltd

Software Developer Internship

Jun 2016 – Nov 2016 · 5 mos · Bangalore

1. User Application (Client side Android application) (Customer can view ,visit, book house.) June - Dec 2016; 3-member team; Build features like OTP login, Social login...etc;
2. Admin Application (Common backend for all application) (Back end support of all the application and tool company uses. ) June - Dec 2016; 3-member team; Build Rest api for features like OTP login, Social Login, Record customer Visit, dedu be customer visit;