Akshay Baviskar

Data Engineer

Bengaluru, Karnataka, India4 yrs 8 mos experience

Key Highlights

Led major data ingestion projects using AWS and Databricks.
Achieved sub-five-minute processing times for large datasets.
Enhanced workflow efficiency by 40% through strategic re-engineering.

Stackforce AI infers this person is a Data Engineering expert with a focus on real-time data solutions in the logistics and data engineering sectors.

Contact

Skills

Core Skills

DatabricksAws ServicesSqlAlteryx

Other Skills

AWS Command Line Interface (CLI)AWS GlueAWS KinesisAWS LambdaAdobe PhotoshopAlgorithmsAmazon DynamodbAmazon RedshiftAmazon Relational Database Service (RDS)Amazon S3Apache Spark StreamingAzure DatabricksBusiness EnglishC (Programming Language)CSS

About

As a Data Engineer at Brillio Technologies Pvt. Ltd., I leverage cutting-edge technologies to deliver impactful data solutions. I have spearheaded the success of three major projects that involved real-time and batch data ingestion, processing, and orchestration using Databricks, Spark, AWS Services, Alteryx, Python, and SQL. Some of my notable achievements include: Leading real-time data ingestion from AWS Kinesis for parcel tracking insights, devising PySpark modules for JSON handling and PII compliance, and conducting over seven Data Quality checks. Developing highly efficient logic to process over 400 million rows within Databricks Delta Lake, achieving runtime performances below the five-minute threshold. Re-engineering Alteryx workflows within the Databricks ecosystem, enhancing efficiency and scalability by 40%. I hold a Bachelor of Engineering degree in Electronics and Telecommunications Engineering from the University of Mumbai, and I am a Databricks Certified Data Engineer. I have also completed advanced coursework in SQL Server and Snowflake, and I am proficient in Apache Spark, AWS, and Alteryx. I am passionate about harnessing data-driven insights to optimize processes and deliver actionable intelligence, driving organizational success and achieving business objectives.

Experience

4 yrs 8 mos

Total Experience

2 yrs 9 mos

Average Tenure

1 yr 11 mos

Current Experience

Rakuten india

Data Engineer - I

Jul 2024 – Present · 1 yr 11 mos · Bengaluru, Karnataka, India · On-site

DatabricksSparkAWS ServicesAlteryxPythonSQL

Brillio

Data Engineer

Oct 2021 – Jul 2024 · 2 yrs 9 mos · Bengaluru, Karnataka, India

Spearheaded the success of 3 major projects by leveraging Delta Live Tables in Databricks Notebooks, Spark, ETL processes, AWS Services, Alteryx, Python, and SQL.
Led real-time data ingestion from AWS Kinesis for parcel tracking insights. Devised PySpark modules for JSON handling, PII compliance, and conducted over 7 Data Quality (DQ) checks.
Developed highly efficient logic to process over 400 million rows within Databricks Delta Lake, consistently achieving runtime performances below the 5-minute threshold.
Designed end-to-end Databricks workflows to orchestrate batch data extraction from over 20 source databases. Implemented Slowly Changing Dimension (SCD) methods with precision.
Obtained a 40% performance uplift through the strategic deployment of Partitioning, Caching, and Broadcast Variables.
Orchestrated Databricks workflows across a suite of more than 25 Databricks notebooks, ensuring precise data processing across Bronze, Silver, and Gold layers.
Crafted over 10 comprehensive architectural frameworks to re-engineer Alteryx workflows within the Databricks ecosystem, enhancing efficiency and scalability.
Engineered over 149 Alteryx workflows within Databricks, significantly enhancing data preparation and analysis efficiency.