Varun G.

Data Engineer

New York, New York, United States7 yrs 8 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in building and optimizing data pipelines.
  • Proficient in Hadoop and machine learning technologies.
  • Strong background in data architecture and governance.
Stackforce AI infers this person is a Data Engineer specializing in Fintech and Healthcare data solutions.

Contact

Skills

Core Skills

Data ArchitecturePythonHadoopData PipelineData ManagementData AnalysisData VisualizationMachine LearningMachine Vision

Other Skills

Data ArchitectsData MaintenancePython (Programming Language)Data LoadingKafkaSpark StreamingDashboard DevelopmentData Pipeline OptimizationJavaMySQLPostgreSQLSplunkJenkinsGithubOpenCV

About

Experienced Data Engineer with a demonstrated history of working in the information technology and services industry. Skilled in DevOps, Amazon Web Services (AWS), Agile Methodologies, Hadoop, and Software Development.

Experience

7 yrs 8 mos
Total Experience
2 yrs
Average Tenure
5 yrs 8 mos
Current Experience

Egen

2 roles

Senior Data Engineer

Apr 2024Present · 2 yrs

Data ArchitectsData MaintenancePython (Programming Language)Data ArchitectureData LoadingPython

Data Engineer

Aug 2020Apr 2024 · 3 yrs 8 mos

Visa

Data Engineer

Sep 2019Aug 2020 · 11 mos · Palo Alto, California

  • Managing, Monitoring and bug fixing the Hadoop Data pipeline which helps to transform, parse billion transactions/ records of data per day
  • Created, developed and involved in kicking off successfully End to End data pipeline for localization of data to consume data locally for countries like India, Russia
  • Setting up the clusters for data management by improving the performance at least +6% and developed applications for the analytics teams that help in the authorization of transactions
  • Designed and Implemented a new architecture which bypasses the old pipeline with new components helping the client to consume the data directly using Kafka
  • Integrated Spark Streaming, Apache Kafka for enabling business functionalities
  • Refactored legacy code to incorporate new features – Improved the code quality and maintainability
HadoopKafkaSpark StreamingData PipelineData Management

Comcast

Data Engineer

Jun 2018Aug 2019 · 1 yr 2 mos · Greater Philadelphia Area

  • Developed applications to analyze customer experience and behavioral trends across the broadband data and other datasets to find actionable insights and provide recommendations
  • Designed and optimized data pipeline systems to achieve performance by 10%
  • Developed Dashboards and data visualizations to communicate business-critical metrics to different audiences within the business- Develop deep analytical insights around the performance of broadband systems
  • Automated the pipeline to enable future developers to iterate on the model and its features quickly
Data AnalysisData VisualizationDashboard DevelopmentData Pipeline Optimization

Biovirtua

Machine Vision Intern

Aug 2017Nov 2017 · 3 mos · San Francisco Bay Area

  • As a part of the project at BioVirtua, was involved in researching different cost-effective technologies for Machine Vision and Machine Learning
  • Experimented with different devices like Kinect to capture images and collect the data and work on it
  • As part of the project created an application on Face recognition and paralysis detection using Machine learning techniques
  • Java and Python to develop the application
  • Involved in various brainstorming sessions to make the product better
Machine VisionMachine LearningJavaPython

Google

CS Student Mentor

Feb 2017Dec 2017 · 10 mos · San Francisco Bay Area

  • * As part of Google IgniteCS program, was working as a Mentor to educate and raise awareness about coding among different age groups. Visited many universities, Community Colleges, Schools to teach new practices.

Radio city india

Marketing Intern

Jan 2016Apr 2016 · 3 mos

  • Managing sponsorship-related activities for different events
  • Developing new advertising campaigns to enhance the branding
  • Maintaining excel data and technical related activities and social media pages
  • Interacting with top-level clients regarding business activities

Education

California State University - East Bay

Master's degree — Computer Science

Jan 2016Jan 2018

Mahatma Gandhi Institute of Technology

Bachelor of Technology - BTech

Jan 2012Jan 2016

Stackforce found 100+ more professionals with Data Architecture & Python

Explore similar profiles based on matching skills and experience