Gopi Asali Gounder

DevOps Engineer

Plano, Texas, United States10 yrs 7 mos experience
Most Likely To Switch

Key Highlights

  • Over 10 years of experience in data engineering.
  • Expertise in building scalable cloud data solutions.
  • Proven track record in real-time data processing applications.
Stackforce AI infers this person is a Data Engineer specializing in Cloud Solutions and Big Data technologies.

Contact

Skills

Core Skills

Data EngineeringCloud SolutionsBig DataSoftware DevelopmentDatabase Management

Other Skills

Agile Application DevelopmentAmazon Elastic MapReduce (EMR)Amazon Web Services (AWS)Apache NiFiApache OozieApache SparkApache Spark StreamingAtlassian BambooAzure Data FactoryAzure Data LakeAzure DatabricksBig Data AnalyticsBitbucketData ValidationDeltaLake

About

👋 Data Engineer with 10+ years of expertise in ETL, cloud solutions, data management, and visualization with Big Data tools. - 4+ years in scalable cloud data solutions using ADF, Databricks, Azure DevOps, Delta Lake, Synapse, and Snowflake. - Developed low-latency, real-time streaming applications using Kafka, Spark Structured Streaming, and Delta Lake. - Skilled in building scalable frameworks with Scala, Python, and Java, optimizing Spark and SQL performance, and applying Data Vault Modeling, Hive Partitioning, and Bucketing. - Experienced in CI/CD with Azure DevOps, Jenkins, Maven, and automated testing. - Strong technical skills and passion for learning new data engineering technologies.

Experience

Tiger analytics

2 roles

Lead Data Engineer

Feb 2024 – Present · 2 yrs 1 mo · On-site

Lead Data Engineer

Aug 2023 – Feb 2024 · 6 mos · On-site

  • Building a data infrastructure in Azure Cloud for the commodity industry to enable centralized data management and analytics workloads. Leading the data engineering teams for data management and sustainability
Azure DatabricksPySparkUnity CatalogMicrosoft AzureAzure Data FactoryData Engineering+1

Singtel

Senior Data Engineer

May 2022 – Jun 2023 · 1 yr 1 mo · Singapore · On-site

  • Implement a comprehensive financial transformation dashboard that offers meaningful insights, visualizations, and analytics related to financial data and processes.
  • Responsible for building data pipelines, transforming data, and handling operations. I collaborate closely with my team to ensure the seamless functioning of Singtel's data service (daas).
Amazon Web Services (AWS)HadoopApache SparkData EngineeringAzure Data FactoryCloud Solutions

Emirates group

Senior Data Engineer

Oct 2021 – Apr 2022 · 6 mos · United Arab Emirates · On-site

  • Stream data integration solution that efficiently captures real-time baggage data from various sources, processes it, and stores it in a centralized data lake platform
  • I played a key part in making a streaming app for Emirates Airlines that handles baggage data well.
spark streamingBig DataSnowflakeAzure DatabricksAgile Application DevelopmentPySpark+13

Publicis sapient

Sr Associate Data Engineer L2

Mar 2019 – Oct 2021 · 2 yrs 7 mos · India · On-site

  • Implement, and maintain a robust data pipeline system that facilitates efficient inventory tracking, management, and the computation of aggregated metrics within a centralized data lake platform.
  • Developed a scalable Spark Scala application for a supply chain project, utilizing Spark SQL and UDFs to process inventory and domain data from RDBMs and raw files into the CDP platform.Created custom APIs and integration tools for Impala to enable distributed storage consumption of platform data.
  • Designed data flow architecture by analyzing cloud components and integrated business products to support analytics use cases.
Big DataAzure DatabricksAgile Application DevelopmentJavaPySparkSqoop+14

Synechron

Data Engineer

Apr 2018 – Mar 2019 · 11 mos · India · On-site

  • Implemented a low-latency streaming application for measuring and monitoring loan provision for customer accounts within the banking.
  • Developed and implemented visual code to evaluate Excel macro calculations for daily data analysis
  • Collaborated with business stakeholders to gather and understand requirements, and then initiated the implementation process.
  • Conducted thorough end-to-end testing of data flow and documented test results.
  • Expertise in Build, Unit testing, System testing, and User acceptance testing.
spark streamingBig DataAgile Application DevelopmentJavaBitbucketData Validation+9

Capgemini

Data Engineer

Sep 2016 – Jan 2018 · 1 yr 4 mos · India · On-site

  • The project involves integrating various banking data sources, processing and transforming the data, and storing it in a well-organized data lake
  • Designed and implemented NiFi workflows for near real-time financial data ingestion and processing.
  • Developed custom NiFi processors to handle specific use cases not available in default processors.
  • Managed hive metadata in layouts for staging and snapshots, utilizing Avro and ORC formats.
  • Built Spark applications using Java for full and incremental processing of dimension and transaction datasets in banking.
Big DataAgile Application DevelopmentJavaSqoopData ValidationGit+8

Tata consultancy services

System Engineer

Mar 2014 – Sep 2016 · 2 yrs 6 mos · India · On-site

  • Developing an advanced analytical framework to evaluate and manage credit risk exposure for a financial institution
  • Designed and developed a Spring Batch application to conduct risk analysis and store results in Gemfire for consumption across multiple systems.
  • Collaborated with onsite team to understand the requirement and implemented the data processing and ingestion workloads
Oracle DatabaseAgile Application DevelopmentJavaSpring BootGitDevOps+3

Education

Muthayammal Engineering College

Bachelor of Engineering (BE)

Jan 2009 – Jan 2013

Government Higher Secondary School - India

HSC — Maths-Biology

Jan 2007 – Jan 2009

Stackforce found 100+ more professionals with Data Engineering & Cloud Solutions

Explore similar profiles based on matching skills and experience