KOTESWARA RAO BAYYANA

Data Engineer

Andhra Pradesh, India4 yrs 8 mos experience

Key Highlights

Expert in designing data pipelines and data engineering solutions.
Proficient in Azure cloud technologies and big data frameworks.
Strong problem-solving skills with a focus on compliance and governance.

Stackforce AI infers this person is a Data Engineer specializing in Fintech and SaaS solutions.

Contact

Skills

Core Skills

Data EngineeringGoogle Cloud Platform (gcp)Azure Data FactorySoftware DevelopmentJava

Other Skills

API TestingAgile MethodologiesAirflowApache AirflowApache AntApache SparkAzure Cosmos DBAzure DatabricksAzure synapse anyaticsBig DataBigQueryC (Programming Language)C++CI/CD pipelinesData Pipelines

About

Greetings to everyone 🎉.Computer Science graduate with experience and extensive education in software design and application development. Strong work ethic in a team or individual settings to drive product success and process efficiency. Strong troubleshooting and problem-solving skills with an analytical mindset. Programming/Scripting Languages: Java, Python,Pyspark, Shell Scripting. Databases: MYSQL, DBMS, SQL Sever, Maria DB. Software Methodologies: SDLC, Agile, Azure DevOps. Cloud Sevices : Azure Databricks, Azure Data Factory, Gen2, Amazon S3, Big QUERY, GCS, compsoer DAGS, Dataproc, DataFlow Big Data Techstack :Hadoop, Spark Ecosystem, Spark Sql, Hive, Linux, Pig Unit Testing: JUnit, Zypher Test cases creation and execution, BDD Test Automation, NTF Testing. Tools: SOAP UI, JIRA Enterprise, Jira release management, Postman, Trello, ServiceNow, TWS, Savynit

Experience

4 yrs 8 mos

Total Experience

1 yr 6 mos

Average Tenure

1 yr 10 mos

Current Experience

Lloyds technology centre india

GCP DATA ENGINEER

Aug 2024 – Present · 1 yr 10 mos · Hyderabad, Telangana, India · On-site

Working as part of the DataHub team, designing and delivering end-to-end data pipelines using Python, PySpark, SQL, and Scala to power KPIs and reporting across the bank.
Built SCD Type 1 & Type 2 pipelines, along with full and delta load strategies, ensuring historical accuracy and efficient daily updates.
Developed Foundational Data Products (FDPs) and Consumption Data Products (CDPs) based on metadata capture documents from SMEs and product owners, aligning technical solutions with business needs.
Used Airflow for orchestration and Tivoli Workload Scheduler (TWS) for scheduling, ensuring reliable execution of daily, weekly, and monthly pipelines.
Applied data masking on sensitive PII/PCI data and generated synthetic datasets in lower environments to maintain compliance and realistic testing.
Structured curated datasets in BigQuery and integrated with Data Catalog to enhance governance, metadata tracking, and data discoverability.
Partnered with product owners and SMEs to translate business requirements into clean, reliable Tableau dashboards, enabling KPI-driven decision making.
Provided production support and warranty hot fixes, monitoring pipelines, troubleshooting issues, and fine-tuning performance to meet strict SLAs in a regulated banking environment with different data partners

Google Cloud Platform (GCP)DataprocApache AirflowApache SparkData PipelinesDatabase Management System (DBMS)+5

Epam systems

Data Engineer

Sep 2022 – Aug 2024 · 1 yr 11 mos · Hyderabad, Telangana, India · On-site

Having 3+ years of experience with exposure to Designing, Developing, Analysis, Implementation to building productized data ingestion processing pipelines solutions and post-implementation support of DW applications using Python, Pyspark, Microsoft SQL Server, Azure cloud technologies such as Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure Synapse Analytics
Designing and implementing a full-scale data warehouse solution based on SQL Server and Building complex SQL Queries, Joins, Constraints, DML to implement the business logic.
Extensively used Azure Data Lake to store the data, Azure Databricks to transform data and Azure Data Factory to Orchestrate the process.
Designing solutions in Azure Data Factory (ADF) using Azure Data Lake Storage, Azure SQL Database, Azure Logic Apps and API’s.
Having proficiency on all types of ADF activities like Copy activity, web activity, dataflow activity, for each activity, Lookup etc.
Designing dynamic pipelines and datasets as reusable components using Configuration table and pipeline parameters
Experience in developing Spark applications using Pyspark in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into customer usage patterns.
Good Understanding of Spark Architecture including spark core, spark SQL, DataFrame, Driver Node, Worker Node, Stages, Executors and Tasks.
Designing an ADF and Databricks workflow to convert CSV data to JSON data using Spark Dataframes
Having good exposure on the Architecture of Azure Synapse Warehouse.

GitdatalakehouseAzure synapse anyaticsAzure Data FactoryApache SparkDatabase Management System (DBMS)+12

Netcracker technology

Junior Software Engineer

Sep 2021 – Aug 2022 · 11 mos · Hyderabad, Telangana, India

Worked as a Junior Software Engineer, utilizing techstacks such as Java, SQL, TBI Script,
TOMS (Telecom Operation Management System), SOAP UI, Tomcat, Ant, SVN, Jira,AS400, BSS Order Management
Collaborating on ETL project enhancements, actively engaging in the migration of AS400 systems.
Contributing to requirements gathering and understanding business processes for effective development.
Utilizing a tech stack featuring Java, SQL, and additional tools specific to AS400 system migration.
Providing estimations and creating low-level design (LLD) for assigned tasks.
Writing SQL queries for data extraction, transformation, and loading processes in the ETL project.
Developing and maintaining code in Java to support ETL workflows and AS400 system migration.
Performing unit testing to ensure code quality, aiming for minimal bugs and high code coverage.
Managing the end-to-end implementation process, including API request/response mapping and server integration.
Enforcing coding standards through checks, aligning with PMD rules and guidelines.

JavaApache AntXMLTOMSAPI TestingTortoise SVN+3

Phablecare

Web Developer

Apr 2021 – Jul 2021 · 3 mos · Bangalore Urban, Karnataka, India · Remote

Worked as a Software Engineer Trainee , utilizing tech stacks such as Java, SOAP UI, JS, MySQL, Tomcat, Ant, SVN
Understanding the business process for enhancements
Gathering requirements from business
Provide estimation for the given story and provide LLD with the flow diagram
Complete the development with minimum bug and write unit test cases and cover the code and provide 90-
100 % code coverage, managing the implementation of one product for a client. As part of product
enhancements and daily bugs, mostly handle API request and response mapping validation and mapping the
backend server values to the API elements, as well as integrating server changes, creating local builds, and
deploying changes to the server.
Check the PMD rule of our own branch and make sure whatever we are delivering it should be according to
the coding standard.
After SIT we upload all documents in JIRA and confluence and close the story.
After that we do a retro-spectrum meeting with the team and discuss what we did good and what we can
do better.

Digital Marketing

The sparks foundation

Graduate Rational Internship Program

Jan 2021 – Feb 2021 · 1 mo · Bangalore Urban, Karnataka, India

Sand-box technologies

Student Intern

Sep 2020 – Mar 2021 · 6 mos · Bangalore Urban, Karnataka, India

Held a volunteer position as a Student Volunteer for Sandbox Technologies. Handled programming duties including web design and record keeping.
Developed WordPress site Content,Newsletter and blog with 20+ pages
Customized a web app to track all 500 delivery clients
Managed online ads to announce regular events and fundraising drives,Organized Multiple Programs on Career Guidance for students
Worked with 40+ team members to produce creative, efficient solution.

Minutes of meetingDigital MarketingTrelloMentoring

Prepinsta

Digital Marketing Intern

May 2020 – Oct 2020 · 5 mos · Nodia

1. Research and identify potential opportunities - including customers/audience/clients, partnerships, products and services, new markets, growth areas and trends
2. Develop strategies, positions and manage workflow
3. Assist in the coordination and implementation of marketing strategies, and delegate tasks that achieve strategic goals
4. Maintain fruitful relationships with existing customers/clients
5. Gather feedback from customers or prospects and share with internal team.

Digital Marketing