Apr 2019 – May 2021 · 2 yrs 1 mo · Gurugram, Haryana, India

• Data Engineer | ETL Specialist
• 📊 Designing and maintaining scalable, fault-tolerant, distributed ETL pipelines using Apache NiFi to ensure seamless data integration across diverse platforms.
• 🛠️ Developing robust scripts in Python and Ruby for data transformation (JSON, CSV, TXT) to facilitate insightful analysis and reporting.
• 🔧 Implementing automated test cases to ensure the quality and integrity of large-scale data ingestion processes, optimizing data reliability and accuracy.
• 🔧 Proficient in tools and technologies including Apache NiFi, Python, Bash scripting, Linux environments, MySQL, MSSQL, and REST APIs for efficient data management and integration.

Sep 2017 – Apr 2019 · 1 yr 7 mos · Gurgaon, India

• Data Pipeline Development: Designed and delivered end-to-end data solutions for streaming & batch processing. Built ETL pipelines with Apache Beam, Airflow, Spark Streaming, and PySpark for scalable data processing.
• API Engineering: Developed Python APIs on Google App Engine for credit report parsing, ensuring scalability and reliability.
• Workflow Orchestration: Automated large-scale data migrations using Apache Airflow (DAG-based workflows).
• Data Modeling & ML:
• Applied feature selection techniques (Forward Selection, Genetic Algorithm, Variable Importance – H2O AI).
• Built & deployed ML models (Decision Trees, GBM, GLM, Random Forest, XGBoost) using H2O Python API & H2O Flow.
• Optimized models via Grid Search and implemented monitoring using PSI, KS, IV, and AUC.
• Data Visualization: Created interactive dashboards & reports in DOMO for model performance tracking and decision-making.

Jul 2016 – Sep 2017 · 1 yr 2 mos · Gurgaon, Haryana, India

• 🛠️ DevOps Engineer | AWS Specialist
• System Administration (AWS Cloud):
• Proficient in managing and optimizing large-scale Linux environments on AWS.
• Automation and Deployment:
• Developed scripts to automate deployment, administration, and monitoring processes, enhancing efficiency and reliability.
• Implemented Ansible playbooks for seamless code deployment and utilized Ansible Tower for managing inventory and resources.
• Monitoring and Reporting:
• Setup and configured company-wide reporting modules on Metabase for comprehensive data insights.
• Implemented Nginx and Kibana for effective visualization of application and system logs.
• AWS Infrastructure Management:
• Designed and deployed auto-scaling groups, alarms, and alerts to ensure high availability and performance.
• Leveraged AWS Lambda and API Gateway for efficient microservices architecture.
• Cost and Resource Optimization:
• Achieved significant cost savings through effective resource optimization strategies on AWS.
• Data Pipelines and Reporting:
• Implemented data pipelines for migrating diverse data sources to a centralized data warehouse, enabling streamlined reporting and analytics.
• Developed various reports and dashboards tailored to the needs of different departments, leveraging visualisation tools.

Jul 2015 – Jul 2016 · 1 yr · Gurgaon, India

• 🔍 Database Engineer
• Query Optimization and Performance Tuning:
• Expertise in troubleshooting slow queries and identifying performance bottlenecks to optimize database performance.
• Implemented strategies to enhance query efficiency and minimize execution time.
• Load Testing and Performance Assurance:
• Conducted regular load tests to simulate high traffic scenarios and ensure optimal database performance under stress.
• Replication Management:
• Designed and maintained database replications across various servers and environments, ensuring data consistency and availability.
• SQL Query Optimization Support:
• Provided guidance and support to developers in writing advanced and efficient SQL queries, optimizing database interactions and application performance.
• Backup and Security Management:
• Managed audit logs and executed scheduled backup plans to maintain data integrity and availability.
• Implemented robust backup strategies to safeguard critical data and ensure disaster recovery readiness.

Jun 2014 – Nov 2014 · 5 mos · Gurgaon, India

• 🌟 Internship in IT Operations | Incident Management & Performance Measurement
• Incident Management Tool Development:
• Developed an incident management tool to streamline tracking of incidents handled by L1 team, including details of owners, on-call schedules, and knowledge base references for efficient escalation.
• Process Automation:
• Successfully eliminated manual processes by replacing multiple Excel sheets with automated workflows, improving accuracy and efficiency in incident management.
• Application Performance Measurement:
• Conducted performance measurements on applications running on the S&P platform to assess and optimize performance metrics.
• Application Health Monitoring:
• Implemented systems to monitor application health, identifying and addressing impacts caused by errors, timeouts, and exceptions to ensure uninterrupted service.
• Performance Baseline Establishment:
• Established baseline execution times for various applications, enabling proactive detection of potential slowdowns and performance bottlenecks.
• Data Visualization and Reporting:
• Utilised Microsoft's BIDS to create insightful charts, graphs, and drill-downs for visualising performance metrics and trends, aiding in decision-making and performance optimisation efforts.