D

Diya Liza Varghese

Data Engineer

United States4 yrs 6 mos experience
Most Likely To Switch

Key Highlights

  • Expert in building scalable data pipelines.
  • Proficient in AWS services and data engineering.
  • Strong background in data science and machine learning.
Stackforce AI infers this person is a Data Engineer with expertise in SaaS and cloud-based solutions.

Contact

Skills

Core Skills

Aws GlueData EngineeringApi ManagementFront-end DevelopmentData ScienceSoftware Development

Other Skills

Python (Programming Language)PySparkSQLAmazon S3SQL Server Management StudioData AnalysisTerraformMySQLDatabasesAmazon RedshiftData WranglingData ModelingTableauAWS LambdaMicrosoft Power BI

About

I am a Big Data Engineer and I work on developing and optimizing data pipelines, workflows, and architectures using various AWS services and tools. I am also a Master of Science graduate in Information Technology from Arizona State University, where I have learned advanced concepts and skills in data science, machine learning, and cloud computing. I have a strong background in web application development, API management, and software engineering, with a Bachelor of Technology degree in Computer Science from Model Engineering College. I can build robust and scalable data pipelines on cloud and on-premise. I have excellent data analysis skills by utilizing Statistical Data Analysis, Python (Programming Language) and Business Intelligence (BI) tools. In my recent work experience, I have spearheaded, contributed to, and supported several projects that involved building, testing, and integrating APIs, data transfer procedures, email templating, and RESTful services using technologies such as Salesforce, Terraform, Handlebars JS, Jest, and React JS. I have also earned two AWS certifications in Solutions Architect and Machine Learning, demonstrating my proficiency and interest in cloud-based solutions and AI applications. I am passionate about problem-solving where I get to solve complex problems, learn new technologies, and collaborate with diverse teams. I believe I can bring value to any organization that is looking for a talented, motivated, and innovative big data engineer.

Experience

4 yrs 6 mos
Total Experience
1 yr 1 mo
Average Tenure
1 yr 4 mos
Current Experience

Cloudflare

Data Engineer

Jan 2025Present · 1 yr 4 mos · Austin, Texas, United States · Hybrid

Tucson police department

Data Engineer

Sep 2024Jan 2025 · 4 mos

Thredup

Data Engineer

Jun 2024Sep 2024 · 3 mos · California, United States · Hybrid

Rocket mortgage

Big Data Engineer

Aug 2023Dec 2023 · 4 mos · Remote

  • Deploy end-to-end AWS Glue ETL process in Pyspark using CircleCI to transform call data from different databases to be delivered for data analysis to the PowerBi dashboard used by executives which has helped to increase callbacks for positive mortgage leads by 25% in a month.
  • Create the SQL ETL stored procedures and triggers in Microsoft SQL Server - SQL Server Management Studio to transform Finance data of the firm of a company product and schedule them in SSIS containers and monitor and resolve critical issues and product support services daily
Python (Programming Language)PySparkAWS GlueSQLAmazon S3SQL Server Management Studio+13

Lumen technologies

Software Engineer Intern

Jun 2023Aug 2023 · 2 mos · Remote

  • Spearheaded the development of a POC for the data transfer procedure between 2 salesforce applications using REST APIs by building, documenting a successful payload and integrating it into the salesforce application using Java code.
  • Improved performance by 70% by efficient PL/SQL queries and documenting Data governance rules across Oracle DB.
  • Contributed to developing a salesforce functionality for customers to opt-out from marketing mails and create test suits for the same by conducting business analysis and attending user-level meetings after production release.
Python (Programming Language)REST APIsSQLSQL Server Management StudioAPI ManagementJava+9

Arizona state university

Web Application Developer

Oct 2022Aug 2023 · 10 mos · Tempe, Arizona, United States · Hybrid

  • Terraformise a REST API that was built for retrieving information to schedule classes on the ASU website using AWS API Gateway, Lambda & S3 and create test cases using Jest.
  • Automate the email templating using Handlebars JS on the HTML code for different stages of course requests by instructors on Canvas site.
  • Build API endpoints for canvas course informations that needed to be used in different ASU requirements and create test cases using JEST.
  • Build front end for course history information using the API built using React JS
Python (Programming Language)HTML5Front-End DevelopmentSQLAmazon S3Terraform+7

Airtics

Data Science Instructor

Oct 2021Jul 2022 · 9 mos · UAE

  • Led the team by coaching students from different backgrounds in Data science, Data visualization, Exploratory data analysis, Artificial intelligence, Data mining, Machine learning.
  • Resposnible for conducting classes, managing sessions, creating new modules, preparing academic syllabus, assignments.
Python (Programming Language)SQLData ScienceData AnalysisMySQLDatabases+5

Deloitte

Cloud Data Engineer

Nov 2020Aug 2022 · 1 yr 9 mos · Bengaluru, Karnataka, India

  • Lead a 12-member data modelling team by owning architecture and developing a full stack application in Python (Programming Language) for automation of data mapping, normalization and transformation of on-premise CSV data to XML files.
  • Utilized OracleDB migration services and OCI Data Integration to acquire and transform 20+ products’ data.
  • Collaborated in the migration of on-premise to Cloud environment for a Fortune 500 client by orchestrating 30% of GLUE ETL with AWS CDK, loaded into S3 and queried using AWS Athena on glue table storage.
Python (Programming Language)PySparkAWS GlueSQLAmazon S3Data Science+14

Microobjects pvt.ltd

Software Developer

Jun 2019Jul 2019 · 1 mo · Kochi, Kerala, India · On-site

  • Executed and presented prototype of a Java application using Google Geolocation APIs in Java programming language by integrating MYSQL by quantifying user preferences into UML Agile tools (Lucid) as a high-quality, usable product to stakeholders in Microsoft Azure stack.
  • Secured client agreement by presenting a dashboard report of the Agile activities by working in close relation with Product Team, UX Designers, and Java Engineers in cross-functional squads
Python (Programming Language)SQLAPI ManagementJavaDatabasesJavaScript+5

Excel mec

Talks Manager

Feb 2019Mar 2020 · 1 yr 1 mo · Kochi

  • Headed the Talk department of Excel 2019, the techno-managerial symposium of Model Engineering College.
  • Displayed effective leadership qualities by hosting more than 50 speakers of national and international importance for an audience of 2000+ students and professionals by leading a ateam of 50 members.
  • Conducted 10 large-scale events over 3 days

Education

Arizona State University

Master of Science - MS — Information Technology

Aug 2022Dec 2023

Model Engineering College

Bachelor of Technology - BTech — Computer Science

Jan 2016Jan 2020

Stackforce found 100+ more professionals with Aws Glue & Data Engineering

Explore similar profiles based on matching skills and experience