Atish Ghaste

Software Engineer

Bengaluru, Karnataka, India4 yrs 8 mos experience

Key Highlights

Expert in designing scalable data pipelines on GCP and Azure.
Proven track record in optimizing data architecture for efficiency.
Skilled in multiple programming languages including Python and SQL.

Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and scalable architecture.

Contact

Skills

Core Skills

Google Cloud Platform (gcp)Apache AirflowGoogle Cloud DataprocData Migration

Other Skills

AWS GlueAmazon Web Services (AWS)Apache SparkBasics of cData AnalyticsDataprocExtract, Transform, Load (ETL)Google BigQueryGoogle Cloud StorageHadoopHiveMicrosoft AzureMicrosoft ExcelMicrosoft Power BIMicrosoft Word

About

Experienced Data Engineer in Google Cloud Platform and Azure. Expertise in designing and implementing scalable data pipelines, ETL processes, and data warehouses. Proficient in BigQuery, Cloud Storage, Dataproc Serverless, ADLS, Azure Data Factory, and Databricks. Skilled in programming languages such as Python and SQL. Proven track record of optimizing data architecture for performance and efficiency.

Experience

4 yrs 8 mos

Total Experience

1 yr 6 mos

Average Tenure

1 yr 10 mos

Current Experience

Carelon global solutions india

Software Engineer - II GCP

Aug 2024 – Present · 1 yr 10 mos · Bengaluru, Karnataka, India · Hybrid

Developing and managing DAGs for data pipeline orchestration, including dependency management, retries, and monitoring.
Deploying and managing containerized applications and batch jobs as part of data processing workflows.
Utilizing GCS as primary data lake for storing raw and processed data, intermediate files, logs, and artifacts. Automated data movement between GCS and other services like Snowflake.
Proactively monitoring data pipeline health and job performance across critical business applications. Investigated failures, resolved data load issues, and ensured timely delivery of SLAs through automated alerts, dashboarding, and root cause analysis.

Google Cloud Platform (GCP)Apache AirflowGoogle Cloud StorageSnowflake

Dataeaze systems

Data Engineer

Mar 2022 – Aug 2024 · 2 yrs 5 mos · Pune, Maharashtra, India

Developed and maintained a custom Spark/Scala framework to build high-performance data connectors. These connectors were instrumental in facilitating large-scale data migration between diverse sources and destinations, ensuring data integrity and efficiency.
Leveraged Google Cloud's Dataproc Serverless architecture to design and implement robust data migration pipelines. This approach enabled seamless, cost-effective, and scalable data transfer within the Google Cloud ecosystem, eliminating the need for cluster management and optimizing resource utilization.

SparkScalaGoogle Cloud DataprocData Migration