Rishabh Maheshwari

DevOps Engineer

Pune, Maharashtra, India10 yrs 3 mos experience
Highly Stable

Key Highlights

  • Expert in Apache Spark and Data Engineering.
  • Proven track record in healthcare data analytics.
  • Strong experience in building data pipelines and workflows.
Stackforce AI infers this person is a Data Engineer specializing in Healthcare data solutions and Big Data technologies.

Contact

Skills

Core Skills

Data EngineeringApache SparkHadoopOozie

Other Skills

AnalyticsApache KafkaApache ZooKeeperData ProcessingData WarehousingHQLHealthcare Data IntegrationHiveMachine LearningMySQLSparkSqoop

About

Spark developer, a self motivated professional eager to enhance skills in data engineering. Working as a Spark developer with experience in Apache Hive,Spark( RDD, SQL, DataFrames, Datasets), Scala,Python, Azure, Snowflake, Hbase, Sqoop ,ESP and Oozie. Also having expertise in shell scripting , HQL, SQL query.Always open up for the challenging role.

Experience

Iqvia

Lead Data Engineer

Sep 2024Present · 1 yr 6 mos · Greater Bengaluru Area · Hybrid

Epam systems

Senior Data Engineer

May 2021Sep 2024 · 3 yrs 4 mos · Pune, Maharashtra, India · Remote

  • Contributed to the development of data-driven solutions for the pharmaceutical industry, specializing in healthcare data integration and analytics.
  • Designed and implemented data pipelines to ingest, process, and analyze large volumes of clinical and patient data, enabling timely insights for research and development teams. • Leveraged advanced analytics techniques to identify patterns and trends in healthcare data, supporting evidence-based decision-making for drug development and commercialization.
  • Collaborated with cross-functional teams to deploy machine learning models for predictive analytics, resulting in improved patient outcomes and operational efficiency for healthcare providers.
Apache SparkData EngineeringHealthcare Data IntegrationAnalyticsMachine Learning

Cognizant

Data Engineer

Aug 2019May 2021 · 1 yr 9 mos · Pune Area, India · On-site

  • In order to prevent using the bank's services for money laundering,
  • terrorist financing and other illegal activities, Account Services must
  • follow the practices outlined in the Global Anti-Money Laundering
  • compliance manual.
  • Security Search Non-$ application provides access to clients to invest via
  • equity and options in different countries and their currencies.
  • Involved in applying various transformations and optimization techniques in Spark .
  • Creating Hive External and internal tables to store the processed results in a tabular format with partitions and bucketing for better performance and Tuning Hive queries to get the best performance.
  • Writing customized Hive and User Defined Functions (UDF) to ease the processing.
  • Writing the script files for processing data and loading into the warehouse.
  • Developing ESP workflow for scheduling jobs.
Apache SparkHiveHQLData ProcessingData WarehousingData Engineering

Tata consultancy services

2 roles

Data Engineer

Feb 2017Aug 2019 · 2 yrs 6 mos · On-site

  • Set up multi node Hadoop cluster on VBox centOs. Tools worked on - Sqoop, Hive, Spark ( DataFrames, RDD, Spark SQL) , NoSql- Hbase, Oozie.
  • Ingesting data using Sqoop from different RDBMS to HDFS vice-versa and Hive as part of Value at risk calculation over trading data.
  • Hive performance tuning to generate reports faster.
  • Spark Hadoop API to transform trading data(csv,orc,Parquet), table and store them on external sources & HDFS.
  • Automating the jobs using Oozie scripts.
HadoopSqoopHiveSparkOozieData Engineering

Data Engineer

Nov 2015Jan 2017 · 1 yr 2 mos · On-site

  • In ADAS application framework for different vehicles from various OEM’s in order to understand the presence of passenger safety features and provide a summary report for the same to the client.
  • Development of log simulator for Simulink functionality PreReverse Acceleration (RPAC) and model creation for Lead CarDeparture Alert (LCDA) functionality.
  • Created Hive External and Internal tables to process and load data .
  • Developed Oozie workflow for scheduling jobs .
HiveOozieData ProcessingData Engineering

Education

Meerut Institute of Engineering and Technology(MIET)

Bachelor of Technology - BTech — Electronics & instrumentation

Jan 2011Jan 2015

Stackforce found 100+ more professionals with Data Engineering & Apache Spark

Explore similar profiles based on matching skills and experience