Pavithrananda Prabhu S

Data Engineer

Berlin, Berlin, Germany14 yrs 4 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in building scalable data systems.
  • Proficient in cloud technologies and data engineering.
  • Strong background in machine learning and IoT solutions.
Stackforce AI infers this person is a Data Engineering expert with a focus on cloud and IoT solutions.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingMachine LearningMainframe ProgrammingDatabase Administration

Other Skills

Datamesh ArchitectureAWS (SNS, SQS, Lambda, EMR, DynamoDB, Kinesis, S3)GCP (Bigquery, Looker)Confluent KafkaKafka ConnectDebeziumFastAPI BackendPythonHelmHelmfilesKubernetesTerraformAirflowGithub actionsSpinnaker

About

Senior Data Engineer with a passion for learning and building innovative data systems. Focused on creating scalable solutions that drive business insights and efficiency. Always eager to take on new challenges and contribute to the growth of data-driven teams

Experience

14 yrs 4 mos
Total Experience
3 yrs 7 mos
Average Tenure
4 yrs 8 mos
Current Experience

Delivery hero

Senior Data Engineer

Oct 2021Present · 4 yrs 8 mos · Berlin, Germany · On-site

  • Senior Data Engineer | Logistics Data Engineering
  • 🔹 Skills: Datamesh Architecture
  • AWS (SNS, SQS, Lambda, EMR, DynamoDB, Kinesis, S3) , GCP (Bigquery, Looker), Confluent Kafka, Kafka Connect, Debezium, FastAPI Backend, Python, Helm, Helmfiles, Kubernetes, Terraform, Airflow, Github actions, Spinnaker, Prometheus, Grafana
Datamesh ArchitectureAWS (SNS, SQS, Lambda, EMR, DynamoDB, Kinesis, S3)GCP (Bigquery, Looker)Confluent KafkaKafka ConnectDebezium+13

Autodesk

Senior Data Engineer

May 2019Jun 2021 · 2 yrs 1 mo · Bengaluru, Karnataka, India

  • Senior Data Engineer | Marketing Data Engineering
  • 🔹 Skills: Qubole, AWS (API Gateway, Glue), Snowflake, Matillion, Airflow, Python, SQL, Trifacta, DBT, Oozie, Hadoop Ecosystem
QuboleAWS (API Gateway, Glue)SnowflakeMatillionAirflowPython+7

Dataglen technologies

IoT Engineer

Aug 2017Apr 2019 · 1 yr 8 mos · Bengaluru, Karnataka, India · On-site

  • IoT Solar Startup (<10 members) | Backend · DevOps · Machine Learning · Data Engineering
  • 🔹 Skills: Django Framework · Edge Computing · MySQL · Cassandra · Apache Druid · RabbitMQ · Python · Scala . R . Google Cloud Platform (GCP) · Kafka Streams · Apache Kafka · Raspberry Pi · Machine Learning
  • DevOps & Cloud Infrastructure
  • Optimized GCP resources, built cost tracking dashboards, and managed Cassandra, Druid, and Kafka clusters with zero downtime. Scaled infrastructure to support high-ingestion IoT workloads.
  • Data Engineering & Machine Learning
  • Developed real-time streaming pipelines with Kafka Streams and designed Cassandra models for IoT. Deployed ML models for energy predictions and led POCs for motor bearing fault detection and solar panel cleaning event detection.
  • Backend Development
  • Collaborated on developing Django REST APIs and data collection module for solar panel sensors on Raspberry Pi.
Django FrameworkEdge ComputingMySQLCassandraApache DruidRabbitMQ+9

Ibm

Mainframe System Programmer

Jun 2011May 2017 · 5 yrs 11 mos · Bengaluru, Karnataka, India

  • Mainframe System Programmer @ General Electric | Discover Financial Services | Time Inc | Citizens Bank
  • 🔹 Skills: COBOL, z/OS, JCL, IBM DB2, DB2 Performance Tuning, CICS, IMS, RACF, TSO/ISPF, SMP/E, z/VM, Mainframe disaster recovery
  • Developed and maintained JCL scripts for batch processing, job scheduling, and automation of mainframe tasks
  • Wrote COBOL programs to interact with DB2, IMS, and CICS environments.
  • Developed REXX scripts for system monitoring, log analysis, and mainframe job automation.
  • Automated DB2 database maintenance using scripts for reorganization, backup, and performance tuning
  • Conducted Disaster Recovery exercises for critical financial clients to ensure system resilience and business continuity.
COBOLz/OSJCLIBM DB2DB2 Performance TuningCICS+8

Education

Birla Institute of Technology and Science, Pilani

Master's degree Remote — Distance Education

Jun 2012Jun 2014

Anna University Chennai

Bachelor of Engineering (B.E.) — Computer Science

Jan 2005Jan 2009

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience