Sabyasachi Some — Data Engineer
1. Working in Airflow, Postgres, Rabbitmq, Redis- on Container Host- for Orchestration, PySpark on EMR for data processing, Redshift for Data Warehousing 2. Worked in Fraud Detection projects in Fintech Industry. 3. Worked extensively on Big Data Hadoop. 4. Fluent in Apache Spark, Hive, Sqoop. 5. Migrating large tables having terabytes of data from multiple sources like SAP, SFTP, Oracle, Informix to Azure Data Lake, EDL, Relational DBs using Azure Data Factory v2.0, Spark, Python, Java, SAS etc. 6. Handling big data chunks in Python by using several code optimization techniques like Chunksize, Multithreading, Multiprocessing, using Parallellism for reduction of overall time complexity. 7. Having hands on experience in data warehousing and an ETL tool(data-stage) 8. Building data pipelines using Spark-Streaming and Shell scripting 8. Sound understanding of datastructures and algorithms. 9. Python (Microsoft 98-381) Certified. 10. Oracle 12C Expert (OCA-1Z0-047) Certified
Stackforce AI infers this person is a Data Engineering expert in the Fintech industry.
Location: Bangalore Urban, Karnataka, India
Experience: 10 yrs 6 mos
Skills
- Data Engineering
- Big Data
Career Highlights
- Expert in Big Data technologies and data engineering.
- Certified in Python and Oracle 12C.
- Proficient in building data pipelines and ETL processes.
Work Experience
Telstra
Data Engineering Senior Specialist (2 yrs 5 mos)
Philips
Specialist 1- Data Engineering (2 yrs 7 mos)
Synchrony
Senior Data Engineer (1 yr 4 mos)
Wipro Technology
Senior Data Engineer (2 yrs 9 mos)
Wipro Technologies
project engineer (1 yr 5 mos)
Education
Bachelor of Technology - BTech at West Bengal University of Technology, Kolkata
at West Bengal Council of Higher Secondary Education
High School Diploma at Ramakrishna Mission Vidyapith, Deoghar
