Vivek Rungta

Data Engineer

Kolkata, West Bengal, India10 yrs 9 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Proficient in building data pipelines and frameworks.
Expert in automating data quality checks and profiling.
Strong background in data engineering within finance.

Stackforce AI infers this person is a Data Engineer specializing in data solutions for the Banking and Finance industry.

Contact

Skills

Core Skills

Data EngineeringPythonInformatica

Other Skills

APIAgile MethodologiesAirflowAlgorithmsAmazon RedshiftAmazon Web Services (AWS)C (Programming Language)Cloud ComputingData LakeData PipelinesData ProfilingData QualityData TransformationData WarehouseDatabases

About

Experienced Software Engineer with a demonstrated history of working in Information Technology in Banking and Finance industry. Skilled in Informatica, Python, SQL, Agile Methodologies, and Data Structures. Strong engineering professional with a Bachelor of Technology (B.Tech.) focused in Computer Science from Techno India, Salt Lake.

Experience

10 yrs 9 mos

Total Experience

2 yrs 8 mos

Average Tenure

4 yrs 8 mos

Current Experience

Agilon health

Data Engineer

Oct 2021 – Present · 4 yrs 8 mos · Kolkata, West Bengal, India · Remote

Built framework which makes multiple API requests calls for downloading data from vendor API, flatten them for retrieving intermediate data and finally loads them to snowflake Developed script to automate data profiling and quality checks on the Patients data received from source Created Stored Procedures for redundant audit queries being invoked multiple times

APISnowflakeData ProfilingQuality ChecksData EngineeringPython

Deloitte

Consultant

Jan 2020 – Oct 2021 · 1 yr 9 mos · Bengaluru, Karnataka, India · Remote

Created multiple data pipelines for on-boarding data to data lake and data warehouse for reporting requirements
Developed Python script for automating QA validation of data files using meta-data file
Automated manual tasks like comparing meta data file for changes, bulk dummy data generation, flattening and comparing json config files using python
Worked on writing pytest cases for automatic unit testing the code
Developed Redshift procedures to compare and load data from staging layer to final layer maintaining versions in data warehouse

Data PipelinesData LakeData WarehousePythonQA ValidationData Engineering

D. e. shaw india private limited

Senior Tech Associate

Oct 2017 – Dec 2019 · 2 yrs 2 mos · Hyderabad Area, India · On-site

Constructed python scripts for creating reports which helps traders analysing data or ensures the quality of data in our system
Debugged and fixed issues raised by traders enabling them to perform their tasks seamlessly
Migrated legacy SSIS jobs on a python-based parser by improving the parser to handle complex transformations
Developed script to automatically re-run jobs on pre-defined set of failures reducing monitoring efforts during off-hours
Documented all issues faced to eliminate the time spent in debugging in case of recurrence of the issue

PythonSSISData QualityReport GenerationData Engineering

Tata consultancy services

System Engineer

Aug 2015 – Oct 2017 · 2 yrs 2 mos · Bengaluru Area, India · On-site

Created mappings with complex transformations for loading data according to the logic provided in FS
Developed scripts and procedures for generating reports based on user requirements
Enhanced performance and fixed technical issues of existing code by developing generic and reusable logic
Interacted with Business Users to help them understand the application better
Deployed multiple scripts successfully to automate and enhance tasks

Data TransformationReport GenerationUser InteractionData EngineeringInformatica