Shivanvitha Narala

Product Manager

Irving, Texas, United States5 yrs 2 mos experience
Most Likely To Switch

Key Highlights

  • Expert in Big Data Engineering and Data Integration.
  • Proficient in AWS and Azure Cloud solutions.
  • Strong background in SQL and data visualization tools.
Stackforce AI infers this person is a Data Engineer specializing in Big Data and Cloud solutions for Fintech and SaaS industries.

Contact

Skills

Core Skills

Big Data EngineeringData IntegrationCloud Data EngineeringData ArchitectureData EngineeringEtl ProcessesData VisualizationBig Data Handling

Other Skills

Oracle PL/SQLHadoopHiveImpalaUnix Shell scriptingSQL LoaderVisual Studio CodeGitBitbucketPythonPySparkSnowflakeAWS Data LakeAWS CloudHDFS

About

Results-driven SQL Developer/PowerBI with a strong background in database management, data integration, and reporting, experienced in Microsoft SQL Server, SSIS, SSRS, Power BI, and Tableau. Proficient in designing, developing, and maintaining databases using MySQL and T-SQL, effectively collaborating with cross-functional teams to optimize stored procedures, queries, and data models in accordance with business requirements. Skilled in implementing ETL processes, data migration, and Azure Cloud solutions, utilizing a range of programming languages, such as Python and T-SQL. Capable of performing data analysis and visualization using ML models and various data visualization tools, with a solid understanding of project management methodologies, including Agile, JIRA, and SDLC methodologies (Waterfall). Adept at communicating and collaborating, committed to staying current with industry best practices and emerging technologies to ensure continuous improvement in database development and management processes.

Experience

5 yrs 2 mos
Total Experience
1 yr 8 mos
Average Tenure
2 yrs 3 mos
Current Experience

Virtusa

3 roles

Power BI Data engineer

Mar 2026Present · 2 mos

  • END CLIENT : BITCO insurance companies

Senior big data Engineer

Feb 2025Mar 2026 · 1 yr 1 mo

  • END CLIENT : CITI BANK

Senior Big Data Engineer

Jan 2024Jan 2025 · 1 yr

  • End client : CITI BANK
  • Developed big data solutions using Oracle PL/SQL, Hadoop, Hive, and Impala within Cloudera frameworks to meet client specifications and improve system performance.
  • Automated data transfers from Oracle databases to Hadoop using Sqoop and Unix Shell scripts, ensuring data integrity and seamless integration across platforms.
  • Managed source code and facilitated team collaboration using Visual Studio Code, Git, and Bitbucket, following Agile Scrum methodology for efficient project delivery.
  • Engineered automated data workflows between relational databases and AWS Data Lake using PySpark and Python, optimizing data extraction and loading for cloud analytics.
  • Tracked and managed development tasks using JIRA, ensuring project requirements were met on schedule and adhering to high standards.
  • Led the transition of data processing scripts from PL/SQL to PySpark, enhancing the scalability and efficiency of data operations in Snowflake and AWS environments.
  • Championed the use of modern big data technologies and methodologies to drive continuous improvement and innovation in data handling and analytics.
  • Environment:
  • Oracle PL/SQL, T-SQL, Cloudera, Hadoop, Hive, Impala, Unix Shell scripting, SQL Loader, Visual Studio Code, Git Bash, PowerShell, Bitbucket, Python, PySpark, Snowflake, AWS Data Lake
Oracle PL/SQLHadoopHiveImpalaUnix Shell scriptingSQL Loader+9

Sivikon tech inc

Senior Data Engineer

Aug 2022Dec 2023 · 1 yr 4 mos · Tampa, Florida, United States · Remote

  • Managed the migration of essential business operations to AWS Cloud using HDFS and Sqoop for data transfer. Streamlined data porting with SQL Loader, ensuring efficiency and accuracy.
  • Developed and established data architecture on AWS, applying SQL, PL/SQL, and T-SQL in Redshift and Snowflake. Integrated Azure Data Factory and Azure Databricks to optimize data handling and analytics.
  • Enhanced SQL query performance with advanced optimization techniques, including analytical functions, joins, and execution plan analysis. Created indexes and materialized views for better data retrieval.
  • Authored and maintained Oracle PL/SQL procedures, functions, cursors, and packages with robust exception handling for high accuracy and reliability.
  • Developed Unix Shell scripts for secure data transfers to AWS S3, using Hive and AWS Secrets Manager for data security.
  • Refined ETL processes in Redshift and Snowflake, building robust data pipelines with S3, EMR, Glue, and Impala integration.
  • Orchestrated data workflows using Airflow and Autosys, aligning with database upgrades and maintenance.
  • Designed Tableau dashboards on AWS, leveraging Hive for data visualization. Extended data manipulation with PySpark and Python libraries like pandas and numpy.
  • Collaborated with QA teams to validate SQL code using Pytest, enhancing the CI/CD pipeline and ensuring high-quality deliverables.
  • Participated in Agile Scrum meetings, managing project timelines and deliverables with JIRA, fostering efficient project management.
  • Environment: AWS Cloud, HDFS, Sqoop, SQL Loader, SQL, PL/SQL, T-SQL, Redshift, Snowflake, Azure Data Factory, Azure Databricks, Oracle, Unix Shell, Hive, Impala, AWS Secrets Manager, S3, EMR, Glue, Airflow, Autosys, Tableau, PySpark, Python (pandas, numpy), Pytest, Git, Bitbucket, Agile Scrum, JIRA.
AWS CloudHDFSSqoopSQL LoaderSQLPL/SQL+25

Genpact

Data Engineer

Aug 2019Jul 2021 · 1 yr 11 mos · Hyderabad, Telangana, India · On-site

  • Directed the architectural design and data modeling, streamlining SQL, PL/SQL, and T-SQL processes and integrating datasets smoothly into our main architecture.
  • Utilized Cloudera Spark APIs and Apache Airflow to automate data imports and ETL tasks, boosting real-time updates and syncing with Redshift and Snowflake.
  • Generated dynamic Tableau dashboards on AWS EC2, tuned SQL and PySpark scripts for better performance, and used PowerShell for system management.
  • Applied Agile Scrum methodology to keep data projects aligned with sprint objectives, managed database migrations from RDBMS to HDFS/AWS S3 with minimal data loss.
  • Enhanced AWS services like Secrets Manager, CloudFormation, Athena, and API Gateways to fortify data security and retrieval, and developed REST APIs with AWS Lambda.
  • Translated business needs into technical specs, focusing on optimizing SQL queries, execution plan analysis, index building, and enhancing data access with materialized views.
  • Facilitated efficient data transfers with Sqoop, improved data storage using Hive and Impala, and ensured solid data handling with robust SQL exception management.
  • Responded promptly to business needs, leveraging SQL and T-SQL for data handling, backed by thorough testing with Pytest.
  • Environment:
  • AWS Cloud Services, HDFS, Sqoop, Hive, Cloudera Spark APIs, Apache Airflow, Redshift, Snowflake, Tableau, PowerShell, Agile Scrum methodology, Pytest, SQL, PL/SQL, T-SQL, PySpark, Linux/Unix Shell scripting, Git, Bitbucket, JIRA.
AWS Cloud ServicesHDFSSqoopHiveCloudera Spark APIsApache Airflow+16

Tiger analytics

Data Engineer

Jul 2018Jul 2019 · 1 yr · Hyderabad, Telangana, India · On-site

  • Designed and built data solutions in Oracle PL/SQL and T-SQL, tailoring them to specific client needs.
  • Boosted database performance by over 30% by optimizing SQL queries, analyzing execution plans, creating indexes, and tuning performance.
  • Turned business needs into technical solutions, streamlining system processes and enhancing efficiency.
  • Developed a system for moving records from RDBMS to HDFS/AWS S3 using Python and Cloudera Spark, optimizing data flow.
  • Set up automated data pipelines with Apache Airflow and created user-friendly Tableau dashboards on AWS EC2.
  • Led the transition from PL/SQL to PySpark, and automated data extractions using AWS Lambda and REST APIs via API Gateways.
  • Integrated Sqoop and Hive for advanced big data handling in HDFS, and managed cloud migrations with AWS Glue, Redshift, and Lambda.
  • Designed data models to optimize database structure and relationships. Implemented Pytest for automating SQL project testing.
  • Developed and maintained project code in Git and managed project activities using Agile Scrum methodology and JIRA.
  • Environment:
  • AWS Cloud Services, Oracle PL/SQL, T-SQL, SQL Loader, Python, PySpark, Cloudera Spark APIs, Apache Airflow, Tableau, Powershell, Autosys, Pytest, Git, Bitbucket, Hive, Impala, Unix Shell scripting, Agile Scrum methodology, JIRA.
AWS Cloud ServicesOracle PL/SQLT-SQLSQL LoaderPythonPySpark+15

Education

University of South Florida Muma College of Business

Master's degree — Business Analytics and Information Systems

Aug 2021May 2023

GITAM Deemed University

Bachelor of Technology - BTech — Computer Science

Jun 2015May 2019

Stackforce found 100+ more professionals with Big Data Engineering & Data Integration

Explore similar profiles based on matching skills and experience