Sahil Sharma

Software Engineer

New Delhi, Delhi, India1 yr 8 mos experience

Key Highlights

Proficient in data engineering and cloud technologies.
Strong experience in Agile methodologies and team collaboration.
Skilled in optimizing data processing and performance.

Stackforce AI infers this person is a Data Engineer with expertise in cloud computing and data processing technologies.

Contact

Skills

Core Skills

Data EngineeringAgile MethodologyCloud ComputingAws

Other Skills

AWS LambdaAmazon S3Amazon SNSAmazon Simple Notification Service (SNS)Apache SparkBoto3Continuous Integration and Continuous Delivery (CI/CD)DatabrickEDL Data CatalogGitHubJenkinsMicrosoft Power BIPysparkPythonRally

About

- Around 2 years of working experience in the areas of Analysis, Development and testing of Data. - Good hands-on experience in Python, Pyspark, Spark SQL, SQL, Databrick. - Good experience in transforming batch data according to the client's Demand. - Comprehensive knowledge of the Agile methodology project. - Have an ability to work with a team. - Flexible and committed to work and likes to take up the new challenges.

Experience

1 yr 8 mos

Total Experience

1 yr 8 mos

Average Tenure

Current Experience

Infosys

2 roles

Senior System Engineer

Promoted

Oct 2022 – Mar 2023 · 5 mos · Chandigarh, India · Remote

I have worked in the Datawarehouse management project. Fetching the data from On premises with the help of Databrick internal environment and storing the data in Enterprise Data Lake (EDL) in raw format. We are processing that raw data with the help of Pyspark, Python, SQL to facilitate the end user to do the business Analysis on that refined data. Good understanding of performance tuning and optimization of spark application. With that, Familiar with the concept of Code optimization, worker node management, Driver Configuration and memory management.
Familiar with the transformation and action operations on RDD and Data Frame API used to transform the data.
With that i am familiar with the EDL data catalog for the creation of the Dataset and tables.
I have a good understanding of agile methodology. We use Rally for application life cycle management. We are following the complete agile process in our project with attending daily scrum calls, weekly Backlog Refinement meetings, Retrospective meetings and internal discussion on user story and task.
We used Jenkins and GitHub for frequent deployment.

DatabrickPysparkPythonSQLAgile methodologyRally+4

System Engineer

Jun 2021 – Sep 2022 · 1 yr 3 mos · Chandigarh, India · Remote

Created the lambda function in AWS Cloud which will send the notification to the user with the help of SNS Service whenever some Json file is uploaded in S3 with the help of Boto3 library.
Sync the production code in GitHub.

AWS LambdaAmazon SNSBoto3GitHubCloud ComputingAWS