Maninder S N. — Software Engineer

Strong Technical Skills include:- AWS EMR, Redshift, Glue, DataBrew, Step Functions, Apache Spark, Beam, pig, hive, Java, Python, Flume, Hive, Cloudera, Java, React JS, Struts, Spring, Hibernate, SOAP and Restful Webservices, IBM MQ , Kafka, Snowflake, MongoDB, SQL, Data Warehouse, Data Lake, SQL, DBT, Autosys,Git,ThoughtSpot, Airflow, Dataiku, Databricks - Created a generic data pipeline framework to ingest zip files containing JSON. The framework flatten the JSON files to store data in structured format in snowflake. - I have designed and developed data pipeline framework using Apache Spark and Python for transforming the data from multiple sources in Hadoop and big data technologies for creating meta data based ETL pipelines. - Good experience in AWS big data technologies like EMR, Glue, redshift, Lambda, python with Apache spark. - Good experience in creating data pipelines in Databricks. - Good experience in Dataiku and migrating work from Dataiku to Snowflake. - Good experience in creating ETL pipelines in Snowflake, Snowpipe and Streaming. - Good experience in creating ETL jobs in Databricks. - Good experience in data governance and masking PII and PCI data. - Designed and developed producer and consumer application for IBM MQ. - Strong offshore and onsite team management experience. - Good experience in requirement analysis and Agile development - Worked in Airlines, Healthcare and Insurance domain

Stackforce AI infers this person is a Data Engineering expert with a focus on AWS and big data technologies.

Location: Dallas, Fort Worth, United States

Experience: 24 yrs 10 mos