A

Arun Sori

Backend Engineer

Amsterdam, North Holland, Netherlands10 yrs 1 mo experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in distributed data systems and data pipeline design.
  • Proven experience in implementing change data capture solutions.
  • Strong background in observability tools and system integration.
Stackforce AI infers this person is a Backend Engineer specializing in SaaS and distributed systems.

Contact

Skills

Core Skills

KubernetesClickhouseNats

Other Skills

GoSQLPostgreSQLPython (Programming Language)JavaC (Programming Language)Apache KafkaGoogle Cloud Platform (GCP)

About

Zealous for low-level details, systems programming, distributed data systems and data pipeline design.

Experience

10 yrs 1 mo
Total Experience
2 yrs 6 mos
Average Tenure
3 yrs 11 mos
Current Experience

Gitlab

Senior Backend Engineer

May 2022Present · 3 yrs 11 mos · Amsterdam

  • Working on consolidating data usage within Gitlab with projects like Siphon that implements change data capture between Postgres and ClickHouse using NATS as the message bus. Enabling abstraction that delivers events between internal systems for variety of use cases from metering to analytics.
  • Worked on delivering observability tools incorporated within Gitlab product as part of Monitor:Observability team. Based on Kubernetes Custom Resources, Kubebuilder and ClickHouse.
  • Responsible for integrating features such as Error Tracking and Tracing; leveraging open source projects like OpenTelemetry.
GoSQLClickHouseKubernetesPostgreSQLNATS

Messagebird

2 roles

Senior Data Engineer

Jul 2020Apr 2022 · 1 yr 9 mos

  • Responsible for delivering and maintaining data products for internal and external customers including reporting API for analytical data with near real time response latency.
  • Maintained the architecture design and the distributed infrastructure of the company data platform.
  • Was heavily involved in rolling out Site Reliability Engineering(SRE) principles and on-call workbooks for my team.

Data Engineer

Nov 2018Jul 2020 · 1 yr 8 mos

  • Responsible for design and maintenance of internal data delivery pipelines handling millions of events originating from messages, calls (among other products) per day. Based on Clickhouse, Kubernetes, GRPC+Go, Google PubSub and Apache Beam. All under near real time constraints.

Wingify

Software Engineer (Data)

Jul 2016Oct 2018 · 2 yrs 3 mos · New Delhi Area, India

  • Worked as part of the Data Layer team at Wingify.
  • Responsible for architecture design and development of a new data pipeline for Wingify's CRO platform, minimizing data loss and outperforming the old pipeline by at least 50%.
  • Based on Openresty, Apache Kafka, Postgres and Redis.
  • Maintaining various microservices forming the data pipeline which are responsible for data acquisition, queuing, processing, and loading into storage systems.
  • Heavily involved in data modeling for analytical use-case(OLAP) for the company's reporting product.

Mozilla

Google Summer of Code Participant

May 2016Aug 2016 · 3 mos

  • Implemented a module for Mozilla Investigator(MIG)[http://mig.mozilla.org/] that support syscall monitoring via Audit Framework present in Linux kernel.
  • Improving and restructuring the audit library libaudit-go.

Encyclokidia

Web Developer Intern

Dec 2015Feb 2016 · 2 mos

Owasp foundation

Summer Code Sprint Participant

Jul 2015Sep 2015 · 2 mos

  • implemented a translator for raw HTTP requests to Python, Bash, Ruby and Php scripts.

Wingify

Software Engineering Intern

Jun 2015Jul 2015 · 1 mo · New Delhi Area, India

  • Worked to develop integration of Wingify's visual web optimizer with various third party platforms.

Mozilla

Team Member

Aug 2014Dec 2014 · 4 mos

  • Worked with Mozilla Security Team. Developed Audit Plugin for Heka as a part of Mozilla Winter Of Security Program.

Education

Jaypee Institute of Information Technology

Bachelor of Technology (B.Tech.) — Computer Science

Jan 2012Jan 2016

Stackforce found 100+ more professionals with Kubernetes & Clickhouse

Explore similar profiles based on matching skills and experience