Pavan Kumar Beela — Data Engineer
Data Engineer specializing in enterprise-grade data pipelines on Microsoft Azure. I have led large-scale migrations from on-prem Hadoop/Hive workloads to Azure Databricks and ADLS Gen2, reducing daily processing time by 40%. I design end-to-end data solutions from raw ingestion (SQL Server, Oracle, REST APIs) through transformation (PySpark, Delta Lake) to delivery (Synapse SQL Pools feeding Power BI). Mainly Built 30+ ADF pipelines with automated CI/CD deployments across Dev, QA, and Prod • Designed medallion architecture (Bronze/Silver/Gold) on ADLS Gen2 • Implemented real-time streaming pipelines with Event Hubs, Stream Analytics, and Kafka on HDInsight • Reduced streaming latency from 5 minutes to under 30 seconds • Secured platforms using Key Vault, Managed Identity, and RBAC I work closely with analytics and business teams to ensure what is built is reliable
Stackforce AI infers this person is a Cloud Data Engineer specializing in Azure data solutions and real-time data processing.
Location: Bengaluru, Karnataka, India
Experience: 4 yrs 6 mos
Skills
- Azure Data Lake
- Python
- Azure Databricks
- Data Engineering
- Data Solutions Design
- Azure Data Factory
- Devops
- Data Architecture
- Streaming Data Engineering
- Azure Data Services
- Cloud Security
- Azure Security
Career Highlights
- Reduced data processing time by 40% through migration.
- Built over 30 automated Azure Data Factory pipelines.
- Implemented real-time streaming with reduced latency.
Work Experience
Tata Consultancy Services
Data Engineer (4 yrs 6 mos)
Education
Bachelor of Technology - BTech at RAJIV GANDHI UNIVERSITY OF KNOWLEDGE TECHNOLOGIES, NUZVID
PUC at RAJIV GANDHI UNIVERSITY OF KNOWLEDGE TECHNOLOGIES, NUZVID
