Ganesh Nayak — Data Engineer

I am a passionate Senior data engineer with having 12+ years of total IT Experience, including 7 years of extensive experience in Big-data/Spark/Databricks and AWS Cloud Technologies. I used to design scalable data warehouse and Data Pipelines. I am equally excited about problem solving, being creative and developing strategic business solutions. Proficient in managing the entire application development operations involving requirement gathering, development of functional specifications, testing and co-ordination with customer. Possesses extensive experience in Spark, Spark-SQL, Spark Streaming, AWS, Python, Hive, ,Airflow, Databricks Worked on creating real time data streaming solutions using Apache Spark Core, Spark SQL & Data Frames, Spark Streaming and Apache Kafka Hands on experience with Databricks and deploying end to end solutions using CICD. Having good knowledge on Amazon S3, EMR, Redshift, Redshift Spectrum, Athena, Glue, Quick insight. Experience in importing and exporting data using Glue from Relational Database Systems and vice-versa. Involved in creating Hive tables, and loading and analyzing data using hive queries. Very good understanding of Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance. Worked on NoSQL database AWS DynamoDB Well experienced in implementing Data Warehouse concepts. Having very good knowledge on designing Star schema, Snowflake schema. Have worked on Monitoring tools like Datadog and Kibana. An effective communicator with honed people management, relationship management, analytical & coordination skills.

Stackforce AI infers this person is a Big Data Engineer with expertise in cloud technologies and data pipeline architecture.

Location: London, England, United Kingdom

Experience: 13 yrs