Pallavi Vetal

Data Engineer

Hyderabad, Telangana, India7 yrs 6 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

7+ years of experience in data engineering
Expert in Azure Cloud Data Stack and data migration
Skilled in data visualization with PowerBI

Stackforce AI infers this person is a Data Engineer specializing in cloud data solutions and data-intensive applications.

Contact

Skills

Core Skills

Data WarehousingPowerbiAzure Cloud MigrationAzure Databricks

Other Skills

Apache SparkApache Spark StreamingAzure Cosmos DBAzure Data FactoryCosmosDBData Quality ChecksHDFSHadoopHiveJavaJavaScriptMicrosoft AzureMicrosoft Power BIMicrosoft SQL ServerMongoDB

About

Data Engineer with 7+ years of experience in building data-intensive applications. Skilled in BigTechnoligies like Hadoop, Hive, HDFS, HBase, and Apache Spark. Well-versed with Azure Cloud Data Stack - Databricks, DataFactory (ADF), Function Apps, Logic Apps, CosmosDB, SQL Server along with networking & security resources like VNet,KeyVault, ExpressRoute. Experienced in data warehousing & migration of on-prem data stack to Azure Cloud. Familiar with data visualization using PowerBI. Known programming/Scripting languages - Scala, Java, Python, Shell, PowerShell.

Experience

Microsoft

Data Engineer

Aug 2021 – Present · 4 yrs 7 mos · Hyderabad, Telangana, India · Hybrid

°° Data warehousing & providing insights via PowerBI reports catering to different personas like Resource Managers, Microsoft Leadership teams, and Product Managers.
°° Enabling data quality checks & security (RLS, CLS)

Data WarehousingPowerBIData Quality ChecksSecurity

Fractal

Data Engineer

Jul 2021 – Jul 2021 · 0 mo · Bangalore Urban, Karnataka, India

Ubs

2 roles

Data Engineer

Promoted

Sep 2019 – Jun 2021 · 1 yr 9 mos

°° Worked on the migration of on-premise data solutions to Azure Cloud. Resources Used: CosmosDB, Azure Data Factory, Azure Databricks, ADLS Gen2, Azure SQL Server.
°° Experience with Azure Databricks notebooks to consume data from ADLS Gen2.Process it, and ingest processed data to CosmosDB. Created and managed Hive as well as Delta tables in ADB. Databricks Runtime : 6.5, Spark: 2.4.3, Scala: 2.11, Hive 2.1.2.
°° Familiar with azure networking & security resources like Azure Vnet, Azure KeyVault, Network Interfaces, SPA.
°° Designed and developed a Spark-based framework to process the data present in HDFS and create reports for UBS regulatory team.
°° Experience in loading and retrieving data from CosmosDB (SQL API) as well as optimizing write and read operations on data stored in CosmosDB.

Azure Cloud MigrationCosmosDBAzure Data FactoryAzure DatabricksHDFSSpark+2