Gaurav K.

AI Researcher

Andhra Pradesh, India14 yrs 4 mos experience

Key Highlights

Expert in Data Engineering and Cloud Solutions.
Proven track record in Data Lake implementations.
Strong background in Business Intelligence and Data Integration.

Stackforce AI infers this person is a Data Engineering expert with extensive experience in Cloud and Big Data solutions.

Contact

Skills

Core Skills

Data ArchitectureData IntegrationData EngineeringCloud Data EngineeringData IngestionData Lake ImplementationCloud MigrationBig Data DevelopmentDatabase Development

Other Skills

AWSAWS CloudAgile MethodologiesAirflowAlteryxAmazon RedshiftAmazon Web Services (AWS)AthenaAutomationBig DataBig-QueryBusiness AutomationCloudCloud ComposerCode-Commit

About

- Experienced in Data Ingestion, Data Integration, Data Virtualization, Data Plumbing. - Experienced in AWS, Big data, Python, Pentaho, Orchestration tool Airflow, IoT Data Management, Snowflake. - Big Data-Cloudera, HDFS, Hive, Impala, Spark, Sqoop, Parquet, ORC, Avro. - Hands-on experience in AWS S3, Glue, Crawler, Athena, SNS, Denodo, Spectrum, lambda, AWS Data Lake. - Worked on Pentaho data integration, Pentaho Report Designer, Pentaho Schema Workbench, Pentaho. - Extensively worked on Data Extraction, Transformation and Loading data from various sources & targets. - Oracle, SQL Server, MySQL database, Flat files, XML, FTP, Json, MongoDB, HDFS, Hive, Impala. - Strong experience in Business Intelligence using Pentaho-BI. - Experience in database programming in PL/SQL. - Well versed with database tuning(Explain Plan, Partitioning, Indexing, Query optimization) and ETL tuning.

Experience

14 yrs 4 mos

Total Experience

2 yrs 7 mos

Average Tenure

1 yr 5 mos

Current Experience

Cbre

Principal Data Engineer

Jan 2025 – Present · 1 yr 5 mos · Hyderabad, Telangana, India

Data Architect | Data Modelling | Data Profiling | Data Governance | Data Quality | Data Ingestion and Integration using different tools and technologies. Domain- Real Estate.

Data ArchitectData ModellingData ProfilingData GovernanceData QualityData Ingestion+2

Algoleap technologies private limited

Data Architect

Jun 2022 – Jan 2025 · 2 yrs 7 mos · Hyderabad, Telangana, India

Client CBRE- AWS | Snowflake |Spark | Python | Athena | Postgres| Data Ingestion | Data Integration | Data Migration | Automation | Data Engineering | Data Architecture

AWSSnowflakeSparkPythonAthenaPostgres+6

Pythian

Senior Cloud Data Engineer-Big Data

Dec 2021 – Jun 2022 · 6 mos · Hyderabad, Telangana, India

GCP| Big-Query | Data-Form| Data Ingestion | Cloud Composer | Cloud | Snowflake

GCPBig-QueryData-FormData IngestionCloud ComposerCloud+2

Hitachi vantara

2 roles

Enterprise Data Architect-Senior

Promoted

Apr 2021 – Dec 2021 · 8 mos

Data Lake on AWS Cloud | Business Automation | Data Ingestion | Data Integration |Data Pipeline | Python | Spark | Redshift| Athena| Airflow | Power BI
Implementing and supporting Data Lake and DataOps in AWS.
Individual contributor developed and supporting Hitachi Finance, Supply Chain, Sales-related Project.

Data LakeAWS CloudBusiness AutomationData IngestionData IntegrationData Pipeline+7

Senior Data Engineer

May 2017 – Mar 2021 · 3 yrs 10 mos

Worked on HV-Data Lake on AWS cloud used AWS services like S3, Glue-Crawler, lambda, batch, Athena, Redshift, RDS, Code-Commit, Database migration services. AWS SFTP.
Ingest data to data-lake from multiple sources like Salesforce, Oracle ERP, MSSQL, Rest-APIs, Anaplan, RevPro, Facebook, etc.
Worked on AWS-managed Airflow for scheduling and Stremsets for data pipeline.
Worked on Python to develop Airflow DAG and Lambda function for Data Pipeline.
Worked on multiple projects to automate the business for Sales, Services, Finance, Supply Chain, HR, Learning Management, Demand Planning, Anaplan, etc.
AWS Migrating on-prem to cloud- Working on migrating Hitachi Vantara on-prem data to cloud data-lake.
Worked on AWS services like S3, EC2, Athena, CloudWatch, CICD pipeline, code commit, lambda etc.
Worked on Pentaho PDI and used Pentaho BI tool like C-tool, Report designer for dashboard and reports.
For scheduling and monitoring worked on Airflow and basic python code.

AWSS3Glue-CrawlerLambdaAthenaRedshift+8

Accenture

Senior Software Engineer- Big Data

Oct 2014 – May 2017 · 2 yrs 7 mos · Pune Area, India

Data Lake | Big Data | Hive | Impala |Sqoop |Data Integration |Pentaho | HiveQL
Big Data/BI Developer
Primary responsibility includes creating jobs and generating reports, dashboards, IoT.
Developed job for fetching data froom API to JSON or XML format and storing into DB for manipulation, SAP to hadoop HDFS.
Implemented incremental load in code while loading the data from source to stage tables.
Implement Bulk load to load data from OLTP to Load area.
Developed the codes for loading data from stage to data mart by using SCD Type 2.
Designed transformation and job using Pentaho Spoon, Alteryx 10
Developed OLAP Cubes using Pentaho.
Schema Work Bench and publish to pentaho user console
Developed dashboard using Saiku, Pentaho dasboard.

Data LakeBig DataHiveImpalaSqoopData Integration+3

Synechron

Software Developer- Data Base

Jan 2012 – Oct 2014 · 2 yrs 9 mos · Pune Area, India

Worked on oracle database,pentaho pdi and pentaho report desiner.
Experienced in designing and developing application using PL/SQL features such as Cursors, Ref-Cursors,
Exceptions, Packages, Stored Procedures, Functions, Triggers, Collections, Bulk Binding, Autonomous
Transaction, and Dynamic SQL Statements etc.
Effectively made use of query optimization techniques such as analyzing Explain Plan, Hints, Indexes,
Table partitioning, Global temporary table.

Oracle DatabasePentaho PDIPentaho Report DesignerPL/SQLQuery OptimizationDatabase Development+1