Sachit Murarka

Software Engineer

New Delhi, Delhi, India11 yrs experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in Apache Spark and Big Data technologies.
  • Proven track record in optimizing data processing pipelines.
  • Strong leadership experience in team management and project delivery.
Stackforce AI infers this person is a Big Data Engineer with expertise in data processing and cloud technologies.

Contact

Skills

Core Skills

Apache SparkData PipelineSparkTeam LeadershipHiveData TransformationPythonWeb DevelopmentC#

Other Skills

KubernetesKafkaOracle CloudREST APIsNi-FiHDFSSqoopOozieDatabasesC# MVCSQL-ServerHTMLCSSjQueryBootstrap

About

Free consultation available for career guidance — book here: https://topmate.io/sachitmurarka Big Data enthusiast experienced in Apache Spark, Hadoop ecosystem, cloud data services, and Python/Scala. Built applications using C# and React to deliver data-driven insights and visualizations. Passionate about debugging and solving complex data issues, with strong data structures fundamentals and scalable pipeline development. Agile-ready with strong communication and client interaction skills.

Experience

11 yrs
Total Experience
2 yrs 2 mos
Average Tenure
4 yrs 3 mos
Current Experience

Microsoft

2 roles

Software Engineer 2 (Level 62)

Mar 2024Present · 2 yrs 3 mos · Noida, Uttar Pradesh, India

Software Engineer 2 (Level 61)

Feb 2022Feb 2024 · 2 yrs · Noida, Uttar Pradesh, India

Oracle

Senior Member Technical Staff

Sep 2020Feb 2022 · 1 yr 5 mos

  • Description:
  • There are different PaaS tools which are being used by external customers. The solution which I have built (Dev Tools Analytics) performs the analysis on top of the application logs and usage pattern of the tools which helps us to get the product insights to improve the customer experience.
  • Responsibilities:
  • o Optimized existing Spark jobs by using ZipWithIndex which improved execution time by 65%
  • o Did the end to end implementation of Spark on Kubernetes.
  • o Developed a Spark Structured Streaming application which connects to Kafka to ingest the records and do transformation.
  • o Developed Data Pipeline using the Serverless Offerings of Oracle Cloud (Streams,Service Connector,OCI Functions,Dataflow)
Apache SparkKubernetesKafkaOracle CloudData Pipeline

Deloitte india (offices of the us)

2 roles

Consultant

Aug 2020Sep 2020 · 1 mo

Business Technology Analyst

Sep 2018Aug 2020 · 1 yr 11 mos

  • Responsibilities:
  • o Participated in Requirement Gathering.
  • o Developed REST API’s.
  • o Played pivotal role in design discussions and suggested the framework design.
  • o Developed Spark Code to do the transformation of the data as per business use case.
  • o Developed a generic & reusable Ni-Fi framework which supports complete data delivery to 3 different end consumers.
  • o Worked on Optimization of the spark jobs which helped in reduction of execution time by up to 40%
  • o Experience in leading a team of 3-4 members, Conducting code quality reviews and suggesting the design to do the build.
  • o Giving design walk-through to client.
  • Achievements:
  • Won 2 Outstanding Performance Awards for playing a key role.
REST APIsSparkNi-FiTeam Leadership

Infosys

3 roles

Senior Systems Engineer

Jul 2018Sep 2018 · 2 mos · Pune Area, India

Systems Engineer

Jul 2016Jun 2018 · 1 yr 11 mos · Pune Area, India

  • Description:
  • EBBD(e-Business Big Data) aims at maintaining a Data Warehouse for the details of the online activities (like clicks, page views, and visits on advertisements of our client on social media) and Sales transactions. Multiple calculations and transformations have been implemented to achieve some fruitful data for analysis purpose and same is maintained in Data Warehouse for future comparisons. Initially, the Data Warehouse was in Oracle and was accessed using PL/SQL. We have migrated entire functionality along with new requirements into Big Data Platform.
  • Responsibilities:
  • o Developed Hive queries to parse the raw data, populate staging tables in parquet format and store the refined data in partitioned tables.
  • o Importing Data into HDFS from Traditional RDBMS.
  • o Developed Hive UDF using Java.
  • o Created Hive tables to migrate the entire history and archive from the legacy Oracle data warehouse using Sqoop.
  • o Created Oozie workflows to automate loading of data in Landing, Staging and Fact Table as per business logic.
  • o Writing adhoc queries in spark using Spark SQL and Spark Core APIs.
  • o Transformation of data and Analysis.
HiveHDFSSqoopOozieData Transformation

Intern

Jan 2016May 2016 · 4 mos · Mysuru Area, India

  • I have worked as an Intern at Infosys Ltd,Mysore.
  • During this 4 months Internship I got trained in Python,Databases,C# MVC, SQL-Server.
  • I have developed a Document Manager Project using C# MVC 5,LINQ, MS-SQL Database ,HTML,CSS,JQuery,Ajax & Bootstrap.
  • Description of Project:
  • There will be author,reviewer and admin for the portal.
  • Admin can create accounts , grant privileges to the users and it can create templates of the documents.
  • Author can create the document, check reviewer's comment on the document , edit the document and delete the document.
  • Reviewer can approve,reject or discard the request submitted by the author of the document.
PythonDatabasesC# MVCSQL-ServerWeb Development

Internshala

2 roles

Internshala Student Partner Buddy

Aug 2015Dec 2015 · 4 mos

  • About Internshala- An online portal which facilitates the students to apply for Internships. Moreover it provides online training on various courses like Java, Web Development, Asp.net, Python, Hacking, Android and Robotics.
  • Internshala has about 900 Internshala Student Partners. My batch had 110 students. My role was to manage them and contact them for all relevant information, updates and sort out their queries.

Internshala Student Partner

Jul 2014Jan 2016 · 1 yr 6 mos

  • My Role:
  • Internshala hires Student Partners from different colleges across the nation. As a Student Partner my role is to promote the services of Internshala in our campus and through online social media.

Xtreme digital solutions ltd.

Web Development Intern

Jun 2014Jul 2014 · 1 mo · New Delhi Area, India

  • In one month Internship(16th June 2014 to 16th July 2014), I have learnt various aspects of Web Designing and Web Development. I have worked on CMS based website development using Wordpress and Joomla. Apart from CMS, I have also worked on PHP based management system.

Education

Lingaya's University, Faridabad

Bachelor’s Degree — Computer Science & Engineering

Jan 2012Jan 2016

Rukmani Devi Jaipuria Public School - India

Apr 2000Mar 2012

Stackforce found 100+ more professionals with Apache Spark & Data Pipeline

Explore similar profiles based on matching skills and experience

Sachit Murarka - Software Engineer | Stackforce