Han You

Data Engineer

Chicago, Illinois, United States4 yrs 9 mos experience
Highly Stable

Key Highlights

  • Expert in large-scale distributed data systems.
  • Proficient in building streaming data pipelines.
  • Strong collaboration with traders and quants.
Stackforce AI infers this person is a Data Engineer specializing in Fintech and SaaS.

Contact

Skills

Core Skills

Data EngineeringBig Data InfrastructureCloud Infrastructure

Other Skills

AWSApache ArrowArgoCDC++CassandraDBClickhouseDockerFlinkJenkinsKafkaKubernetesPythonScalaSparkSpark/Databricks

About

Data engineer experienced in large-scale distributed data systems. Familiar with the data engineering side of the options market-making/trading industry, from working with traders to build streaming data pipelines to extract trade signals out of market data feed, to performing complex analysis over years of tick data for post-trade quant researches.

Experience

Imc trading

Data Engineer

Aug 2024Present · 1 yr 7 mos · Chicago, Illinois, United States

ScalaC++KafkaFlinkSpark/DatabricksClickhouse+6

Akuna capital

5 roles

Non-Compete / Garden Leave

Oct 2023Aug 2024 · 10 mos

  • Sitting out non-compete period. Not open to opportunities.

Software Engineer III (Data Infrastructure)

Promoted

Oct 2023Oct 2023 · 0 mo

  • Designed and developed large-scale distributed data infrastructure to handle big data (10+ TB per day) ingestion, processing, and query.
  • Designed, built, and owned critical datasets (e.g. order entry, market data).
  • Worked with quants and traders to turn ideas into production-grade data pipelines. Built tools and datasets for trading signals and post-trade researches.
  • Tech stack: Scala, C++, Kafka, Flink, Spark/Databricks, Clickhouse, Apache Arrow, CassandraDB, AWS, Kubernetes.
KubernetesSparkPythonDockerJenkinsArgoCD+3

Software Engineer II (Data Infrastructure)

Feb 2023Oct 2023 · 8 mos

Junior Software Engineer (Data Infrastructure)

Jun 2021Feb 2023 · 1 yr 8 mos

Software Engineer Intern (Data Platform)

Jun 2020Aug 2020 · 2 mos

  • Developed a workflow scheduler on Kubernetes to run various Spark/Python/Docker jobs. Enable ETL on data sources such as Kafka, SQL, and Databricks.
  • Leveraged Jenkins and ArgoCD to CI/CD with AWS and on-premise servers.
  • Built web frontends using React.js and Bootstrap.

Jw player

Software Engineer Intern (Video Platform)

Jun 2018Aug 2018 · 2 mos · New York City Metropolitan Area

  • Developed a video transcoding quality monitor. Integrated the service with RabbitMQ and a custom auto-scaler on EC2 worker group.
  • Worked on RESTful API services in an Agile team. Automated CI/CD on AWS, using Jenkins, Docker, and Kubernetes.

Guangzhou sinobest information technology ltd

Research Engineer Intern

Aug 2016Sep 2016 · 1 mo · Guangzhou-Foshan Metropolitan Area

  • Built and optimized Java applications based on Apache Lucene. Performed JVM tuning and hot-path micro optimization.
  • Developed a graph recommendation system based on product requirements gathered from stakeholders.

Education

University of Michigan

Bachelor of Science - BS — Computer Science

Jan 2019Jan 2021

Colorado College

Bachelor of Arts - BA — Computer Science

Jan 2017Jan 2019

Stackforce found 100+ more professionals with Data Engineering & Big Data Infrastructure

Explore similar profiles based on matching skills and experience