Kartikay Thakkar

Senior Software Engineer

Pune, Maharashtra, India7 yrs 11 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in large scale ETL processes and data warehousing.
Proficient in machine learning and data integration.
Strong background in cloud services with AWS and Azure.

Stackforce AI infers this person is a Data Engineering and Machine Learning specialist in the SaaS industry.

Contact

kartikaythakkar007@gmail.com LinkedIn

Skills

Core Skills

Data EngineeringBig DataSoftware DevelopmentMachine Learning

Other Skills

PySparkDatabricksJiraData StructuresFlaskSQLPythonAWS – Lambdas3GlueAthenaStep FunctionEvent BridgeAWSSnowflake

About

● Senior Software Engineer with 6+ years of accelerating experience, specializing in ETL process, Machine Learning, Software Development, Data Warehousing, Data Modelling with AWS and Azure. ● Excellence in implementing and managing large scale ETL processes and developing APIs to support creating & publishing reports, alongside expertise in technical skills for addressing complex architectural and scalability challenges. SKILLS ● Programming Languages: Python, Java, R, C, C++, Scala ● Data Structures and Algorithms ● Big Data Technologies: Pyspark, Databricks, Airflow, Tableau, Spark, CI/CD, Kafka Streaming, Veracode ● Web Frameworks: FastAPI, Flask ● Cloud Services: o AWS: Lambda, s3, Glue, Athena, Step Function, Event Bridge, EC2, Load Balancer, Secret Manager o Azure: Azure Data Factory, Azure Databricks, Azure Logic Apps, Azure Storage, SQL Server ● Data Science: Machine Learning, Natural Language Processing (NLP) ● Database: SQL, Snowflake, PostgreSQL, MongoDB ● DevOps Tools: Kubernetes, Docker, CI/CD Pipeline using Jenkins, Terraform ● Cataloging Tools: Datahub, Data Observability, Data Governance, Data Discovery, Data Modeling ● Linux, Unix, Shell Scripting, Gitlab, Github ● Libraries: NumPy, Pandas, Matplotlib, Seaborn, Scikit-learn, NLTK, Spacy ● Agile & SDLC: JIRA, Agile Scrum, Kanban Workflow

Experience

7 yrs 11 mos

Total Experience

1 yr 6 mos

Average Tenure

2 yrs 6 mos

Current Experience

Nvidia

Senior Software Engineer

Nov 2023 – Present · 2 yrs 7 mos · Pune District, Maharashtra, India

Zs

3 roles

Business Technology Solutions Associate Consultant (Senior Data Engineer)

Promoted

Jul 2022 – Oct 2023 · 1 yr 3 mos

PySparkDatabricksData EngineeringBig Data

Business Technology Solutions Associate (Data Engineer)

Jan 2021 – Jun 2022 · 1 yr 5 mos

JiraPySparkData Engineering

Business Technology Solution Analyst Trainee (Data Engineer)

Jul 2020 – Dec 2020 · 5 mos

JiraPySparkData Engineering

Fourbrick technology

Software Developer

Mar 2020 – Jul 2020 · 4 mos · Noida, Uttar Pradesh, India

● Engineered a suite of 15+ robust backend APIs using Flask and SQL.
● Engaged in real-time data analytics and machine learning endeavors, harnessing data from 6 live sensor data streams for insightful analysis.

JiraData StructuresSoftware Development

Cetpa infotech pvt. ltd.

Machine Learning Engineer

Jun 2019 – Jan 2020 · 7 mos · Noida, Uttar Pradesh, India

● Trained 200+ students in Machine Learning, Deep Learning with a primary focus on Python.
● Conducted over engaging 10 webinars and workshops on Python and Machine Learning.

Data StructuresPythonMachine Learning

Freelance

Freelancer

Feb 2018 – Jun 2019 · 1 yr 4 mos

Machine Learning
Experience building end to end machine learning products related to recommendation system, predictive analytics and sentiment analysis of customer reviews in E-commerce domain.
Data Acquisition
● Demonstrated expertise in data integration from APIs to regularly fetch data from sources, serving as a valuable resource for the analytical needs of innovation and marketing teams.
● Extracted data from APIs including applying fan-out approach, multiprocessing to increase the efficiency and reduce time complexity to fetch 10,000’s JSONs in one go without getting the lambda timeout or memory issues.
● Deployed a Glue job for incremental data loading and orchestrated step function. This automated orchestration runs every 6 hours using Event Bridge.
● Wrote Terraform scripts for different applications to manage deployments for all 3 environments (development, QA, production) with the same infrastructure code.
● Skills: Python, Pyspark, SQL, AWS – Lambda, s3, Glue, Athena, Step Function, Event Bridge
Snowflake ETL
● Architected the Snowflake data warehousing solution as per business requirements and reduced execution time by 50%.
● Created 2 Snowflake streams for source data ingestion, facilitating seamless data transformations.
● Developed 15+ stored procedures to perform complex data processing, data cleansing, unit testing and implement business logic, demonstrating proficiency in data manipulation, query optimization.
● Enhanced data security and compliance by implementing data governance policies, including data masking techniques that reduced exposure of sensitive information by 80% within Snowflake data warehousing solution.
● Skills: Snowflake Tasks and Stored Procedures, Snowflake Streaming, Snowflake Stage