Daniel S.

Software Engineer

San Jose, California, United States22 yrs 3 mos experience

Most Likely To SwitchHighly Stable

Key Highlights

Expert in distributed systems and data processing.
Proven track record in leading complex data projects.
Strong communicator with a passion for knowledge sharing.

Stackforce AI infers this person is a Big Data Engineer specializing in distributed systems and data architecture.

Contact

Skills

Core Skills

Distributed SystemsData ProcessingData ArchitectureService DevelopmentBig Data EngineeringData IntegrationBusiness Intelligence

Other Skills

JavaPythonScalaApache KafkaApache SparkHadoopReal-time Data SharingBig DataReal-time SystemsData SolutionsData WarehousingApache PigHiveSQLOracle

About

I'm a Software Engineer specializing in distributed systems and services. I will find a better, more efficient way to do it at scale. I'm that rare mix of someone who understands what you need, can communicate with you, and will get things done with the highest precision possible that keeps working for years I've spoken at industry events and scientific conferences, and love to expand and share my knowledge. I specialize in these technologies: • Python, Scala, and Java • Hadoop, Spark, Kafka, Redis

Experience

22 yrs 3 mos

Total Experience

4 yrs 5 mos

Average Tenure

13 yrs 1 mo

Current Experience

Adobe

3 roles

Lead Software Engineer

Promoted

Jul 2020 – Present · 5 yrs 10 mos

Adobe Data Platform Team - In charge of designing, building and leading projects for disturbed data processing tools, services and APIs that are used by product developers and Marketing Services teams to interface with Adobe data across multiple clouds and data centers.

JavaPythonScalaApache KafkaApache SparkHadoop+3

Sr. Software Engineer

Jul 2016 – Jul 2020 · 4 yrs

Adobe Data, Architecture and Platform Team - Responsible for building services that allow products and departments to collect and share data in real time.

JavaPythonScalaReal-time Data SharingData ArchitectureService Development

Sr. Big Data Engineer

Apr 2013 – Jul 2016 · 3 yrs 3 mos

Adobe IDS Big Data Self Service Team – Responsible for end to end data processing and building big data systems to work in both batched and real time

Big DataData ProcessingReal-time SystemsBig Data Engineering

Netflix

Senior Data Integration Architect

May 2012 – Sep 2012 · 4 mos · Los Gatos, CA

Customer Platform Team – Responsible for end to end data solutions of customer account and subscription information for Netflix EDW and business units

Data SolutionsData WarehousingData IntegrationData Architecture

Saama technologies

Business Intelligence Developer

Sep 2011 – May 2012 · 8 mos · Campbell, CA

Consulting Services
Project Experience
Client: KIT Digital (Sezmi)
Project: Data Integration For Content Management / Delivery System
Position: Data Modeler / Data Integrator
Integrate XML Schema files from Media Service companies that contain Video on Demand metadata and Electronic Programming Guide metadata to KIT Digital’s (Sezmi) video on demand product and video streaming service using Pentaho Data Integrator
Create data architecture models for each phase of integration (staging, aggregation and target) on MySQL. Data models support both, the content management and content delivery systems.
Improve Content Publishing Service (CPS) process by 300% through ETL and SQL query performance tuning for KiT Digital (Sezmi) video on demand product. Cutting down the process time from 40 minutes to 12 minutes.
Client: Genentech
Project: Clinical Operations Data Mart / Reporting
Position: Data Analyst Engineer
Validate data integrity between Enterprise Data Warehouse and Clinical Operation Data Mart and reports using Duplicate elimination and Data transformation methodology
Assure that all Informatica ETL processes were aligned with business rules and processes for Clinical Operation Studies