Akshay Kumar

Data Engineer

Hyderabad, Telangana, India5 yrs 7 mos experience

Highly Stable

Key Highlights

Expert in building scalable data pipelines.
Proven track record in optimizing data processing.
Strong leadership in data engineering projects.

Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and big data processing.

Contact

Skills

Core Skills

Data EngineeringCloud ComputingDevops

Other Skills

ADFAWSAd Hoc AnalysisAircraft DesignAircraft SystemsAirflowAnalytical SkillsApache AirflowApache SparkAstronomyAstrophysicsAthenaAzureAzure Data FactoryAzure Databricks

About

As a data engineer, I design and execute data pipelines using Python, AWS, SQL, Spark, Power BI, Azure, GCP, Snowflake, Apache Spark, Apache Airflow and other tools and technologies. I have successfully delivered data solutions for projects in the various domains, extracting, processing, and structuring unstructured data from multiple sources, applying business logic and NLP techniques, and creating data visualizations to interpret data insights. I graduated with a Bachelor of Technology degree in Mechanical Engineering from Amrita School of Engineering Bangalore in 2021, where I was also the president of the Astrophysics Club and have won the third prize at the International Space Development Conference in 2016. I am an enthusiastic developer with a passion for learning new skills and technologies, and a motivation to contribute to the development and success of esteemed organizations. Skill Set :- Python, SQL, AWS, Azure, Snowflake, Data Structures and Algorithms, OOP, Excel, Spark, Git, Jenkins, Microsoft Power Bi, Tableau, Apache Airflow, Hadoop, Hive, Data Warehousing, Data Modelling, GCP, Scala, MySQL, PostgreSQL, ETL, Big Data, Data Marts, NoSQL, Big Query, Data Bricks, Delta Lake, Data Lake, Glue Studio.

Experience

5 yrs 7 mos

Total Experience

1 yr 10 mos

Average Tenure

1 yr 10 mos

Current Experience

Bristol myers squibb

Software Engineer II - Data Engineer

Aug 2024 – Present · 1 yr 10 mos · Hyderabad, Telangana, India · Hybrid

PythonApache SparkSnowflakeAWSAzureGCP+11

Cognizant

2 roles

Data Engineer

Promoted

Sep 2021 – Jul 2024 · 2 yrs 10 mos

Tech stack: Python, Apache Spark, Snowflake, AWS, Azure, GCP, Visual Studio Code, SQL, Jupyter Notebook, Excel, Kedro Framework, Oracle, SQL Server, Airflow, Azure Databricks, BigQuery, ADF, Glue Studio, Control-M, Airflow
Created an AWS-based data pipeline using Redshift, Athena, Lambda, Kinesis Firehose, EC2, S3, IAM, Glue, Dynamo DB, Event Bridge, EMR, RDS, and SQS, handling over 1 TB of data weekly.
Employed PySpark and SQL for Big Data processing, transformation, and analysis, reducing data processing time by 30%.
Led the Orchestration of the data flow from AWS S3 to Snowflake, leveraging Python Multi-Threading and SQL for extraction and loading of XML and CSV files on EC2 instance, and employing stored procedures, views, and functions for advanced data manipulation, increasing data accuracy by 80%.
Increased the speed of data loading process by 70% and reduced the cost of data loading into Snowflake data warehouse by 25% using efficient queries.
Worked with Snowflake concepts such as SCDs, Snow Pipe, Streams, Staging, Cloning, CDC and Time Travel, managing data for thousands of transactions.
Developed data pipelines utilizing delta lake architecture using Azure Data Factory (ADF), Azure Synapse, Azure Storage Accounts, Databricks.
Used GitHub, Gitlab and Jenkins for CI/CD and performed data analysis using SQL and Excel, achieving data accuracy by 75% and mitigating inconsistencies by 50%.
Integrated Apache Airflow and Control-M for orchestration, managing 20+ workflows efficiently.
Led the engineering of a Python-based data pipeline, utilizing web scraping, Adobe API, NLP techniques, regex, and Pandas/NumPy along with Matplotlib, increasing data processing speed by 50%.