Apr 2024 – Jan 2025 · 9 mos · Hyderabad, Telangana, India · Hybrid

• As a Software Engineer - II at Dun & Bradstreet, I design and implement scalable data solutions to empower business intelligence, analytics, and data-driven decision-making for global information services.
• My key responsibilities include:
• Data Engineering & Pipeline Development:
• Develop and optimize ETL pipelines using PySpark on Google Cloud Platform (GCP) to process large-scale datasets (e.g., business entity data, financial records, credit analytics).
• Design efficient SQL queries and data models for structured and semi-structured data to support reporting and APIs.
• Implement data transformations and aggregations to enhance Dun & Bradstreet’s data products and services.

Nov 2023 – Present · 2 yrs 6 mos · Hyderabad, Telangana, India · Remote

• >Intervue helps you accelerate hiring by taking up candidate interviews.
• >I'm Evaluating the Data Engineer Interviews for both Freshers & Experienced Candidates.

Jan 2023 – Present · 3 yrs 4 mos · Remote

• Talks about #bigdata, #dataengineering, #programmerslife, #bigdataanalytics, and #bigdatadeveloper

Jul 2022 – Mar 2024 · 1 yr 8 mos · Hyderabad, Telangana, India · Hybrid

• Developed Spark applications using PySpark for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time,
• correct level of Parallelism and memory tunning.
• Performed unit testing on 20+ new scripts weekly for identifying bugs and coordinated with team to fix them.
• Performed the actual code conversion according to the defined strategy. (SAS Code to PySpark).
• Modify and refactor the codebase to meet the target language or framework standards.
• Test the converted code for functionality and compatibility.
• Collaborate with the technical lead to resolve technical challenges.
• Ensure version control and documentation of the converted code.
• Develop and execute test plans for the converted code.
• Verify and validate the functionality and performance of the converted code.
• Identify and report any issues or bugs in the converted code and resolving the issues.
• Ensure compliance with coding standards and best practices.
• Document the code conversion process and guidelines.
• Create user manuals and technical documentation for the converted application.
• Manage the code in GitLab and allow to track changes, collaborate with team members, and maintain a history of codebase.

Sep 2021 – Jun 2022 · 9 mos · Hyderabad, Telangana, India · Remote

• Design, development and implementation of performant ETL pipelines using python API (PySpark) of Apache Spark on Databricks
• Integration of data storage solutions in spark – especially with AWS S3 object storage.
• Performance tuning of PySpark scripts.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources like SAP Hana, MySQL and other data sources.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Building Reusable Data ingestion and Data transformation frameworks using PySpark.
• Coordinated with business customers to gather business requirements. And interact with other technical peers to derive technical requirements and delivered the BRD and TDD documents.

Mar 2019 – May 2021 · 2 yrs 2 mos · Noida, Uttar Pradesh, India · On-site

Mar 2018 – Apr 2018 · 1 mo · India · Remote

May 2017 – Jun 2017 · 1 mo · Madhapur, Hyderabad · On-site