ANKIT KUMAR SINGH — Engineering Manager
• 11+ years of experience in Data warehouse application Development, Testing and Production Support on Healthcare, Insurance, Retail and E-commerce Domain. • 8 +years of experience in providing analytics-based business solutions using Hadoop Ecosystem (Hadoop, Cloudera, Impala, Hortonworks). • Expertise in Big Data Technologies Hadoop Ecosystem, HDFS, Sqoop, Scala, Python, Spark, Kafka, Spark Streaming, Informatica PowerCenter, Oracle, DB2, HBase,, Unix, JIRA, Autosys, Airflow • Experience in importing and exporting data from RDBMS to HDFS, Hive tables and HBase by using Sqoop. • Deep knowledge in incremental imports, partitioning and bucketing concepts in Hive and Spark SQL needed for optimization. • Experience in processing large set of Structured, Semi-structured, Unstructured datasets and Streaming data using Spark. • Experience working on Spark in performing ETL using Spark Core, Spark-SQL and Real-time data processing using Spark Streaming. • Worked with different file formats like JSON, XML, Avro data files and text files. • Ability to troubleshoot and tune relevant programming languages like SQL, Python, Scala, PIG, Hive, RDDs, Data Frames. • Experience in NoSQL databases such as HBase and Cassandra. • Developed end to end ETL Pipeline using Spark, Scala and Kafka API’s • Good Understanding of Big query and Migration Agent in GCP • Knowledge on Cloud Computing with Amazon Web Services like EMR, EC2, S3 • Optimized Hive QL/ pig scripts by using execution engine like Tez, Spark. • Good Understanding of Different RDBMS databases like Oracle, Teradata, Netezza. • Experience in Writing Complex SQL queries and Optimization. • Good understanding of Datawarehouse Concepts and RDBMS databases such as SQL Server, Oracle & Teradata • Good understanding of Software Development Life Cycle and development methodologies (Agile/Waterfall). • Experienced in handling production support which includes monitoring online, production batch runs, problem determination and Providing resolution. • Excellent verbal and written communication skills, with ability to lead a project team through entire project lifecycle.
Stackforce AI infers this person is a Big Data Engineer with extensive experience in healthcare and e-commerce sectors.
Location: Bengaluru, Karnataka, India
Experience: 12 yrs 1 mo
Career Highlights
- Over 11 years of experience in data engineering.
- Expert in Hadoop ecosystem and big data technologies.
- Proficient in developing end-to-end ETL pipelines.
Work Experience
Commonwealth Bank
Engineering Manager (1 yr 7 mos)
Lead Data Engineer (1 yr 9 mos)
Rakuten
Senior Data Engineer-II (9 mos)
Senior Data Engineer-I (2 yrs 1 mo)
Data Engineer (1 yr 9 mos)
Logitech
Data Engineer (6 mos)
AstraZeneca
ETL Developer (1 yr 1 mo)
Anthem, Inc.
Software Developer (2 yrs 8 mos)
Education
Bachelor of Technology (B.Tech.) at Raj Kumar Goel Institute of Technology, Ghaziabad