Jatin A.

Senior Software Engineer

Pune, Maharashtra, India15 yrs 6 mos experience
Highly Stable

Key Highlights

  • Expert in designing self-healing data pipelines.
  • Proficient in data engineering and analytics tools.
  • Strong background in big data technologies.
Stackforce AI infers this person is a Data Engineering expert with a focus on Big Data and Analytics in the Healthcare and Finance sectors.

Contact

Skills

Core Skills

Data EngineeringData ArchitectureData AnalyticsBig DataMachine Learning

Other Skills

AWSAlgorithmsAmazon Web Services (AWS)ApacheApache AirflowApache KafkaApache NiFiApache SparkArtificial Neural NetworksBig Data AnalyticsC++CUDACloud ComputingClouderaComputational Geometry

About

As a Senior Software Engineer at Calix, I focus on designing and implementing self-healing data pipelines utilizing the Medallion Architecture, with an emphasis on data reliability and accessibility. My work ensures seamless data integration while adhering to best practices for sensitive data masking across platforms like RDMS, APIs, and Kafka. With over 5 years in data engineering, I specialize in leveraging tools such as Apache Airflow, Data Build Tool (DBT), and Google Cloud Platform (GCP) to enhance analytics capabilities. My mission is to contribute to robust data ecosystems that empower stakeholders with reliable and actionable insights.

Experience

15 yrs 6 mos
Total Experience
2 yrs
Average Tenure
2 yrs 3 mos
Current Experience

Calix

Senior Software Engineer

Mar 2024Present · 2 yrs 3 mos · Bengaluru, Karnataka, India · Hybrid

  • Re-designed and re-implemented self-healing data pipelines for a DataLake using Medallion Architecture.
  • Ensured sensitive data masking across various data sources, including RDMS, APIs, and Kafka.
  • Enhanced data reliability and accessibility, leading to improved analytics capabilities for stakeholders.
PySparkApache KafkaExtractTransformLoad (ETL)Scala+13

Ubs

Associate Director(Data Engineer)

Oct 2019Mar 2024 · 4 yrs 5 mos · Pune, Maharashtra, India · On-site

  • Defining data domains for alternative investments to architect data modernization solution.
  • Built analytics tools to save both time and cost for business stakeholders.
  • Developed data analytics solutions that provides insights to Quant Researchers.
  • Designed and implemented highly scalable backtesting framework to replace legacy system.
  • Built ETL pipeline on Azure to web scrap and store EDGAR dataset onto Azure ADLS Gen2.
  • Implemented data quality platform to monitor data quality as part of Data Governance initiative.
  • Designed Knowledge graph for data visualization, data lineage and data analytics needs.
Data StructuresData ModelingPySparkExtractTransformLoad (ETL)+14

Phenom people

Product Development Engineer II

Jul 2019Oct 2019 · 3 mos · Hyderabad Area, India · On-site

  • Modelled data into Graphs to identify patterns using graph algorithms.
Data StructuresData ModelingPySparkBig DataData EngineeringData Manipulation+8

Elogicsquare analytics

Senior Data Engineer

Mar 2017Jun 2019 · 2 yrs 3 mos · Bengaluru, Karnataka, India

  • Worked on building a real time predicative-analytics health-care platform using HDF and HDP. Used Java for coding plus related technologies like NIFI, SPARK, KAFKA, ZOOKEEPER, HBASE, HIVE, IGNITE and POSTGRES for building the platform. Followed Agile methodology using JIRA, BITBUCKET, BAMBOO and Confluence. I also deployed an elastic search cluster using Docker. I have used Devops tools like Docker, Bamboo, Jenkins, Git etc.
Data StructuresData ModelingFeature ExtractionData Flow AnalysisPySparkApache Kafka+21

Avr edge networks

Full Stack Developer

Oct 2016Feb 2017 · 4 mos · Bengaluru Area, India

  • Matching engine using drools and apache spark.
Data StructuresData ModelingPySparkApache KafkaBig DataData Engineering+8

Imaginea technologies inc.

2 roles

Development Engineer

Oct 2014Sep 2016 · 1 yr 11 mos

  • I have worked as as full stack developer for first 6 months on AdTech project using Python, MySQL in backend and AngularJs in front end.
  • After that I got an opportunity to work on Big Data and Machine Learning. I have implemented technique, Latent Semantic Analysis(LSA) using MLIB of Apache Spark and Scala for processing 105 GB of jave code on a standalone cluster containing 4 nodes for building contextual code semantic search engine. These work was done for Imaginea Labs as part of Kodebeagle project.
  • In order to improve retrieval time of results, I have experimented and successfully improved retrieval time of queries using locality sensitive hashing (LSH) on 105GB of data. These work was done for Imaginea Labs as part of Kodebeagle project.
  • After I have proposed a novel algorithm for mining patterns in control flow graphs of java code snippets. Algorithm does clustering and frequent subgraph mining on control flow graphs to mine and discover possible patterns for any given API( Application programming interface). Algorithm concentrates on finding data flow between methods of same object to understand possible usage pattern. Later this usage patterns are suggested to users(Developers) for better understanding of language API's. These work was developed using Java and scaled using Apache Spark.
  • I also worked on sentiment analysis using Standford coreNLP, scala and Apache Spark.
Data StructuresData ModelingFeature ExtractionPySparkApache KafkaBig Data+13

Software Development Engineer

Oct 2014Sep 2016 · 1 yr 11 mos

Data ModelingSemantic ModelingPySparkApache KafkaBig DataScala+13

Vlead iiit hyderabad

7 roles

Project Engineer

Mar 2014Oct 2014 · 7 mos

  • My responsibilities include developing of web performance analysis and optimization framework for Virtual labs hosted on IIIT Server. We started with client side web performance optimization and developed automated framework for analyzing and visualizing web performance for thousands of web pages using tools like YSLOW.
AlgorithmsScalability

Graduate Research Assistant

Aug 2013Feb 2014 · 6 mos

  • Made an automated frame work that uses power of both CPUs and GPUs. Framework is build using MPI, open MPI and CUDA programming. It will use CPUs and GPUs as slaves in huge cluster with master controlling slaves. Each slave machine can have multiple CPU's or GPU's which are controlled by a controller at each slave machine.

Graduate Teaching Assistant for Principles of Infomation Security (Cryptography)

Promoted

Jan 2013May 2013 · 4 mos

  • Conducting classes, taking tutorials and helping course instructor in preparing and making lectures useful for students.
Data StructuresComputational GeometryDistributed SystemsAlgorithms

Graduate Teaching Assistant for Discrete Maths and Algorithms

Aug 2012Dec 2012 · 4 mos

  • Conducting classes, taking tutorials and helping course instructor in preparing and making lectures useful for students.

Graduate Teaching Assistant for Principles of Infomation Security (Cryptography)

Jan 2012May 2012 · 4 mos

  • Conducting classes, taking tutorials and helping course instructor in preparing and making lectures useful for students.

Graduate Research Assistant on Virtual Lab under MHRD, Government of India

Aug 2011Dec 2012 · 1 yr 4 mos

  • Making virtual experiments to enhance students understanding of cryptographic concepts.

Research Scholar

Aug 2010Jul 2013 · 2 yrs 11 mos

  • I studied following fields of theoretical computer science Data Structures, Algorithms, Complexity Theory, Cryptography, Distributed Algorithms and Computational Geometry. I have tried to solve some of the open problems in above mention fields.
  • My thesis with title "Efficient Data Structures and Algorithms for Range-Aggregate problems" is on two fundamental problems of computational geometry, "Planar Range Skyline" and "Planar Range Convex Hull". These problems require rigorous analysis of geometrical structures and complexity theory skills. The problem is even more critical because it has strong application in VLSI, Databases, Data Mining, Computer vision and Computer Graphics.

Pramati technologies

Development Engineer

Jan 2014Sep 2016 · 2 yrs 8 mos · Hyderabad Area, India

PySparkApache KafkaBig DataScalaData EngineeringData Manipulation+8

Crypsis technologies pvt. ltd.

Web developer

Sep 2012Dec 2012 · 3 mos

  • I worked on designing user interface using haml, object oriented css and other web technologies. I also got some exposure on Ruby on Rails framework.

Education

International Institute of Information Technology Hyderabad (IIITH)

MS by Research — Computer Science

Jan 2010Jan 2013

Princeton College of Engineering and Technology,Hyderabad,India

Bachelor of Technology (B.Tech.) — Computer Science Engineering

Jan 2005Jan 2009

Stackforce found 100+ more professionals with Data Engineering & Data Architecture

Explore similar profiles based on matching skills and experience