Akanksha Gupta — DevOps Engineer

Having 8 years Experience in data analysis, data processing and Development in Big Data technologies. To develop the spark job to give insight to raw data by processing it and automate the data pipeline through Microsoft azure. Created work flows load data from Blob to Azure Synapse SQL Warehouse(DWH). Create the data pipeline through Azure Data Factory. I have worked on snowflake for loading and maintaining the data. Developed Spark core and Spark SQL scripts using Scala for faster data processing. Involved in converting Hive/SQL queries into Spark transformation using Spark RDD’s. Working on Hadoop 1.x/2.x cluster architecture and Monitoring the cluster. Working with Hadoop Clusters using Hortonwork(HDP) distribution. Involved in creating Hive tables, loading with data and writing Hive queries which will run internally in map Reduce way. Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting. Involve in Requirement Analysis, Design, and Development.

Stackforce AI infers this person is a Big Data Engineer with expertise in data pipeline automation and analytics.

Location: Noida, Uttar Pradesh, India

Experience: 8 yrs 2 mos