Deepak Bansal

Data Engineer

Bengaluru, Karnataka, India10 yrs 8 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in building real-time data pipelines at scale.
Proficient in big data technologies and distributed computing.
Strong background in CI/CD and Agile methodologies.

Stackforce AI infers this person is a Fintech Data Engineer with expertise in big data technologies and real-time processing.

Contact

dbansal@visa.com +918927213573 LinkedIn

Skills

Core Skills

Data EngineeringApache SparkEtl

Other Skills

AgileAlgorithmsApache KafkaBig Data AnalyticsBusiness StrategyC++ LanguageCI/CDCoding LanguagesCryptographyData AnalysisData MiningData Pipeline DevelopmentData StructuresDatabasesExtract, Transform, Load (ETL)

About

I am working as a Staff Data Engineer (i6) at VISA Inc. Bangalore I have total 6+ years of experience as a Data Engineer at Visa - Worked with Visa Data labs, which processes over a billion financial transactions per day, enriches and stores and creates data-driven applications. I have extensive experience in big data technologies using distributed computing paradigms like Hadoop, Apache Spark, Hive, Map-Reduce, building batch processing and near real-time data applications. I have proficiency in multiple programming languages including Java, Python, Scala, C and have extensive experience of data science tools/frameworks like Ab-initio, Python libraries(NumPy, SciPy,sci-kit-learn, pandas), SQL, Hive, etc. I have strong command in SSDLC, CI/CD pipelines and Agile framework.

Experience

Visa

4 roles

Senior Staff Data Engineer

Promoted

Aug 2023 – Present · 2 yrs 7 mos

Staff Data Engineer

Mar 2021 – Aug 2023 · 2 yrs 5 mos

VISA data manager (Debit auth and clearning) - Spark real time Data Pipeline Development
Designed a data processing pipeline using Apache Spark and Java, provisioning near-real-time datasets
Achieved 15K transactions per second(TPS) processing 1.2 billion financial transactions per day
Strong beckground on CI/CD pipeline and SSDLC.

Apache SparkJavaData Pipeline DevelopmentCI/CDSSDLCData Engineering

Senior Data Engineer

Promoted

Mar 2018 – Mar 2021 · 3 yrs

I have created end to end transaction data flow for Event processing by real time application. I used Spark with java for data processing and shell scripting for real time application.VISA have already integrated this product with several banks in USA so far as value-added services
I have Worked in Hadoop ecosystem to migrate VISA’s legacy ab-initio based architecture to Hadoop for faster and efficient processing of data for business sides report generation
Redesigned ETL pipeline using Spark, Hive, Pig & Shell scripting cutting the processing time by around 80%
Learnt good practices Agile methodology using JIRA, Rally for software development
worked with Jenkins to facilitate the automated code deployment (Continuous integration, Continuous deployment)
working with best practice by doing regular commit and push the code into GIT repository

HadoopSparkShell ScriptingETLAgileJIRA+3

Software Engineer

Aug 2015 – Mar 2018 · 2 yrs 7 mos

Pepperfry

Internship

May 2014 – Jul 2014 · 2 mos · Mumbai Area, India

1) Established a social motivated project "Save the earth Plant a Tree" currently live on pepperfry
2) Identified parameters, Designed and implemented a model for default sorting of items in all categories
3) Integrated "Rich desktop Notifications Module" which directly enhanced marketing and customer relations
4) Analyzed Customer Checkout flow with the help of company statistics obtained from Google Analytics ; Improved Sign in, Registration/Sign up and Payment selection page for mobile website

Institute for development & research in banking technology (estd by rbi)

Summer Intern

May 2012 – Jul 2012 · 2 mos · Hyderabad Area, India

1) Implemented a suitability analysis of data mining tools Orange, KNIME and Weka
2) Researched ICMS and Bandwidth utilization databases of member bank transactions using KNIME
3) Identified periodicity of incidents in the INFINET Network using scattering, parallel coordinate views Achievement
4) Ideated and developed a desktop data mining application customized in accordance with relevant datasets