Manish Joshi — Data Engineer

I consider myself a learner and a problem solver. Around 5 years of experience in migrating on-premise ETL systems to the cloud. Helped setup process for Different Client Teams along with developing ETL solutions on Google Cloud Platform. What I can do: - Development of Airflow Pipelines for the clients which will be helpful to orchestrate and monitor the workflow by using DAGs and managed Airflow Services like Cloud Composer. - Develop scripts to extract data from various databases, create files and push to other locations like SFTP servers or GCS buckets. - Handle granular level custom roles and permissions with Cloud IAM. - Manage databases - Cloud SQL, BigQuery, Cloud Spanner, Firestore. - Manage Service accounts. - Write complex SQL queries for analysis and reporting. - Designed Event driven application by using Cloud Functions in GCP. - Analyse data using data prep. - Develop custom data pipelines in Python using Apache beam. Design, code, configure, and document cost-optimized, performance enhanced, scalable and automated batch processing, streaming pipelines with data extraction and transformation to migrate On-premise systems to Cloud. Staying motivated to learn something new everyday.

Stackforce AI infers this person is a Data Engineering expert specializing in cloud-based ETL solutions.

Location: Pune, Maharashtra, India

Experience: 6 yrs 7 mos