Grace K.

Data Scientist

Canada7 yrs 1 mo experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Expert in building enterprise-scale data platforms.
  • Proven track record in optimizing distributed systems.
  • Strong leadership in mentoring engineers and team collaboration.
Stackforce AI infers this person is a Data Engineering expert in SaaS and E-commerce sectors.

Contact

Skills

Core Skills

EtlData ArchitectureData EngineeringData Pipeline Development

Other Skills

AWS GlueAirflowAmazon Web Services (AWS)Apache HadoopApache HiveApache SparkApache SqoopBusiness AIBusiness AnalysisBusiness Process ManagementCloud StorageCronDL/DW/DM architecturesDL/DW/DM pipelinesDW/DM architecture

About

Data Engineer with extensive hands-on experience in designing and building enterprise-scale data platforms, pipelines, data lakes (DL), data warehouses (DW/OLTP), and data marts (DM/OLAP). Proven ability to optimize distributed systems with Spark, Hadoop, Hive, Delta Lake, and Kafka. Skilled in data mining, validation, and governance, ensuring end-to-end data quality and reliability. Strong expertise in architectural design, performance tuning, and team leadership, delivering high-performance platforms for analytics, BI, and machine learning.[TECHNICAL SKILLS]-Data Lake / Warehouse / Mart: Architecture Design, Modeling, ETL/ELT Pipelines, OptimizationDistributed Processing -ETL: Apache Spark, Hadoop, Hive, HDFS, Sqoop, Airflow-Streaming & Storage: Kafka, Delta Lake, ElasticsearchProgramming: Python, SQL, Bash, JavaCloud Platforms: AWS (S3, Glue, Athena), Databricks-Databases: MySQL, Oracle, Delta Lake-Optimization: Query Tuning, Partitioning, AQE, Broadcast Join, Tez ExecutionDevOps -CI/CD: Jenkins, GitLab, Git, Jira, Confluence, Slack, MicroTeamsData Quality -Governance: Automated ETL Testing, Validation Frameworks, Reconciliation, Data Consistency Checks[URL]- https://github.com/jiyooonkim/Coding- https://github.com/jiyooonkim/data-engineer

Experience

None

Big Data Engineer

Jan 2023Present · 3 yrs 2 mos · Hybrid

  • Built and optimized enterprise ETL pipelines and DL/DW/DM architectures using Spark, Hive, Airflow, AWS Glue, and Databricks.
  • Improved DW/DM ingestion by 30% through query and cluster optimizations and tunning.
  • Designed governed data marts and validation frameworks for BI and ML.
  • Operated global MES DW/DM pipelines for factories in US & Philippines.(Databricks)
  • Mentored engineers in distributed architecture design & pipeline optimization.(On-pemis, Databricks, AWS)
ETL pipelinesDL/DW/DM architecturesSparkHiveAirflowAWS Glue+3

Wemakeprice

Big Data Engineer

Jun 2021Jan 2023 · 1 yr 7 mos

  • Developed DL/DW/DM pipelines for recommendation, search optimization, and ranking services.
  • Automated RDB-to-DL ingestion(Apache sqoop) and centralized orchestration in Airflow.
  • Designed data marts for behavioral analytics, keyword-product matching.(Analytics with Engineering)
  • Improved search relevance via distributed text-processing (typo correction, stopwords, brand extraction).
DL/DW/DM pipelinesrecommendation servicessearch optimizationAirflowApache SqoopData Engineering+1

Kies

data engineer

Feb 2019Jun 2021 · 2 yrs 4 mos · Seoul, South Korea · On-site

  • Built DW/DM architecture for e-commerce transactions and financial reconciliation.
  • Developed ETL pipelines in Python & SQL for kibana dashboards.
DW/DM architectureETL pipelinesPythonSQLData EngineeringData Architecture

Education

Bachelor of Engineering - BE — 컴퓨터 공학(소프트웨어)

Mar 2015Aug 2019

Stackforce found 100+ more professionals with Etl & Data Architecture

Explore similar profiles based on matching skills and experience