S

Smriti Jain

Data Engineer

Sultanpur, Uttar Pradesh, India3 yrs experience
Most Likely To Switch

Key Highlights

  • Migrated 15+ ETL workflows with 99.9% consistency.
  • Improved data reliability by 40% through optimized frameworks.
  • Versatile in data engineering and software engineering.
Stackforce AI infers this person is a Data Engineer with expertise in SaaS and cloud-based big data solutions.

Contact

Skills

Core Skills

EtlDatabricksData QualityPythonSoftware DevelopmentJava

Other Skills

AWSApache AirflowBPMNBootstrapCascading Style Sheets (CSS)CommunicationContinuous Integration and Continuous Delivery (CI/CD)Delta LakeFull-Stack DevelopmentHTMLJavaScriptManagementProblem SolvingPySparkPython (Programming Language)

About

I’m a Data Engineer with 2+ years of experience building scalable data pipelines, optimizing ETL workflows, and implementing data quality frameworks. My expertise lies in SQL, PySpark, Databricks, Delta Lake, and AWS, with a strong foundation in data modeling, lakehouse architecture, and cloud migration. At TCS, I’ve: • Migrated 15+ ETL workflows from Informatica to Databricks SaaS with 99.9% consistency. • Improved data reliability by 40% and validation accuracy by 30% through optimized DQ frameworks. • Reduced file processing time by 25% by redesigning pipelines for shared-mode clusters. Beyond my professional work, I actively practice DSA and problem-solving, with 300+ problems solved on LeetCode and a 6-star HackerRank profile. This helps me bridge the gap between data engineering and software engineering, making me versatile across both domains. I’m passionate about designing data-driven solutions, solving complex problems, and continuously learning new technologies to deliver business impact. 🔹 Key Skills: SQL | PySpark | Databricks | AWS | Delta Lake | Data Quality | ETL | Python | Java | Apache Airflow 🔹 Open to opportunities in Data Engineering, Software Engineering, and Cloud-based big data solutions.

Experience

Tata consultancy services

Software Developer

Aug 2023Present · 2 yrs 7 mos

  • Enhanced data quality (DQ) checks and ETL workflows, boosting validation accuracy by 30% and reducing false positives.
  • Led migration from Amazon EBS to Databricks Volumes, improving data reliability by 40%.
  • Optimized ETL pipelines on shared-mode Databricks clusters, ensuring 100% security compliance.
  • Reduced template file processing time by 25% through optimized S3 access patterns.
  • Provided production support, cutting issue resolution time by 50%.
  • Automated orchestration of ETL jobs using Apache Airflow, improving scheduling and monitoring.
  • Integrated CI/CD pipelines for seamless notebook deployment, reducing manual intervention.
Continuous Integration and Continuous Delivery (CI/CD)Data QualityETLApache AirflowDatabricks

Beyond exams

Software Development Intern

May 2023Jul 2023 · 2 mos · Remote

  • Designed and implemented automated test frameworks using Python and Selenium.
  • Developed test scripts to ensure comprehensive test coverage.
  • Collaborated with cross-functional teams to understand project requirements and identify test scenarios.
Python (Programming Language)JavaScriptSeleniumUnit TestingPython

Goldman sachs

Summer Analyst

Jul 2022Aug 2022 · 1 mo · Bengaluru, Karnataka, India

  • Worked on introducing new flags in an already existing dashboard.
  • Created a workflow for automating the manual tasks.
  • Created different Autosys jobs for triggering the java application invoking the workflow.
  • Designed different API's.
Software DevelopmentFull-Stack DevelopmentREST APIsJavaSQLReact.js+4

More than marks

Student Coordinator

Jul 2021Nov 2021 · 4 mos · Gurugram, Haryana, India

ManagementCommunication

Cryptosathi organization

Frontend Developer

Aug 2020Sep 2020 · 1 mo · India

Cascading Style Sheets (CSS)HTMLSQLBootstrap

Education

PSIT Kanpur (Pranveer Singh Institute of Technology)

Bachelor of Technology - BTech — Computer Science

Jan 2019Jan 2023

Stackforce found 100+ more professionals with Etl & Databricks

Explore similar profiles based on matching skills and experience