Pulkit Varshney

Senior Software Engineer

New York, New York, United States8 yrs 5 mos experience

Most Likely To Switch

Key Highlights

Over five years of experience in Big Data and Analytics.
Expertise in designing scalable applications for high event flows.
Proficient in multiple programming languages and frameworks.

Stackforce AI infers this person is a Fintech and SaaS expert with strong capabilities in Big Data and cloud technologies.

Contact

Skills

Core Skills

Data PlatformApache KafkaBig Data AnalyticsAmazon Web Services (aws)

Other Skills

AWSAWS LambdaAlexa Skills Kit (ASK)AlgorithmsAmazon DynamodbAngularJSApache HudiApache SparkAspect-Oriented Programming (AOP)AvroC (Programming Language)C++Cascading Style Sheets (CSS)CassandraData Science

About

Hey, I am currently working with Bloomberg in Company Financials Data Platforms with company earnings and broker estimates. I have over five years of SDE work experience majorly in Big Data Platforms, Systems and Analytics with a daily event flow of > 3 Billion and scalable applications development. From Algorithms, creating optimal and reusable frameworks, CI/CD, and Software Development, my interest spans out to Big Data, Machine Learning and Data Science. Language: Python, Java, TypeScript, JavaScript, React.js, C, LaTeX, Scala Tools, Tech, and Frameworks: SpringBoot, Spark, D3.js, Hadoop, Kafka, Cassandra, RabbitMQ, Grafana, Kibana, Confluent, FCM, Jira, Spring Security, Linux, Git, Jenkins, REST, Drools, AWS Kinesis, AWS Firehose, DynamoDB Streams, AWS Glue, Lake Formation, Athena, Apache Hudi. Databases: MongoDB, ElasticSearch, Aerospike, MySQL, DynamoDB, Clickhouse, Hive, S3. Feel free to reach out to me for interesting conversations!

Experience

8 yrs 5 mos

Total Experience

1 yr 8 mos

Average Tenure

3 yrs 5 mos

Current Experience

Bloomberg

Senior Software Engineer

Jan 2023 – Present · 3 yrs 5 mos · New York, New York, United States · On-site

Worked with Company Financial Data Platform under FA and MODL : Migration of Terminal’s core product FA(Financial Analysis) to MODL with read throughput of 200M events/hr to provide deep segments, enhanced KPIs, and Geo structured data for both company earnings and broker estimates. Also, designed optimal partition schemes for faster access to cater Bulk and Point in Time queries (as of date). The data is stored as blobs, and processed as parquet.
Data Backfill :Saving data in Temporal Blob Stores flowing with high volume & velocity. Creates decoupling from the sources for replays.
Consensus :Brokers predict estimates for companies for future periods(Annual,Quarter,etc). Created a framework to generate broker consensus(mean/std deviation/median,etc) and catering staleness activities of invalid brokers.
Alerts and Distribution :Most of the pages are static after loading a security. Created a notification alert pipeline to refresh the screen if subscribed clients’ current FA/MODL view has been updated.
Technologies used: Kafka, Cassandra, Comdb2(My Sql), Python, Scripting, Avro, Humio, Parquet, BBDS

Software InfrastructureData platformApache KafkaPython (Programming Language)Cassandra

Stony brook university

3 roles

MS Grader

Aug 2022 – Dec 2022 · 4 mos

MS Grader for the Graduate bridge course of Data Structures and Algorithms(CSE-582) under Prof.
Pramod Ganapathi.
Created Homework Assignments, Exam Papers, and their solutions over Latex, and held office hours.

Graduate Research Student

Jan 2022 – Dec 2022 · 11 mos

At HLAB (Human Language Analysis Beings) under Supervision of Professor H. Andrew Schwartz, and Oscar Kjell, from Lund University, Sweden

Graduate Teaching Assistant

Jan 2022 – May 2022 · 4 mos

CSE-316: Software Development under Prof. Joydip Mitra

Amazon web services (aws)

Software Engineer Intern

May 2022 – Aug 2022 · 3 mos · Seattle, Washington, United States

Worked with AWS Pinpoint Analytics for the Digital Customer Engagement team to create a central data lake with ETL and ITL components.
Designed data schemas with Dimension Stores and Fact Tables for performance measures/KPIs related to user engagement, campaign outreach, journey performance and conversion, and audience profile. Planned the architectures and implementations for future data storage, reporting, and analytic solutions.
Technologies used: Typescript, AWS (S3, DynamoDB, Kinesis, Firehose, Glue, Streams, Lakeformation), Apache Hudi, Scala-Spark, Delta Lake, Star Schema.

ScalaApache SparkAmazon Web Services (AWS)Big Data AnalyticsTypeScript

Relevel by unacademy

Evaluator

Jul 2021 – Aug 2021 · 1 mo

Revel is a platform for mock interview preparation. Worked as a code evaluator and an interviewer.

Airtel x labs

2 roles

Senior Software Engineer - Data Intelligence

Jan 2021 – Aug 2021 · 7 mos

Senior Software Engineer

Jul 2019 – Jan 2021 · 1 yr 6 mos

Advertisement Technology - A push-based campaigning platform reconciling channels (SMS/WhatsApp/APP/Web/Email). Daily userbase > 200 Million with the downstream system working 20k TPS ascribed to a config-driven code.
Business Impact: Helped Airtel centralize its notification system. Data Analytics on Campaign Goals (Recharges/Installations/Clicks, etc) were calculated within the custom attribution window, adjudicating the profitability of the campaign.
Federation: A connector-based microservice fetches the result of any query agnostic of the downstream DBs. Finds the niche connectors with user-defined SLAs among DB adaptors: MongoDB, MySql, ElasticSearch, Hive, Clickhouse, Aerospike, APIs, etc.
Communication Engine: All push notifications sent with their callback listeners and webhooks integrated into a context-driven fashion. Pluginplay-plugout code with the scrubbing of notifications based on custom rules (Filtering, throttling, Scrubbing, Exclusions).
Other Responsibility: Code reviews and refactoring, Interviewing, Scripting, SWOT, DevOps work for deployments, and Mentoring.

Samsung electronics

Software Developer

Jul 2017 – Jul 2019 · 2 yrs · Noida Area, India

Promotion Services - Assigns benefits(Coupons and GiftCards) of service(membership of Netflix/Prime/Deezer etc) and TVs to current and new Samsung Smart TV users. Worked upon Batches, APIs, and UI Portal and integration with the checkout server. At Admin side, Manage role-based user access and component rendering- authentication with assoToken and authKey linked via Samsung’s service- IMS(SSO). Technologies used: Node.js, AngularJS, Java, Spring Boot, AWS( Lambda, DynamoDB, ECS, SQS, S3, Cloudwatch, CloudTrail, EC2, RDS)
Log Management: Real-time analysis, server maintenance, error handling, and Alarm
monitoring of twitter and Music (internal projects). Technologies: ELK stack, Beats, Kafka.
Voice assistant on Digital Media: Any nearby song playing is fingerprinted and matched with TV+ content(Samsung's video streaming service) Business Impact: Increase TV+ viewership, identify redundant content and recommendation engine. Extended to get audio URL or buffer through voice assistant by creating intents, Alexa skills using Alexa AVS SDK, google assistant skills through dialogue flow and IFTTT(already created applets), which connects to Samsung IoT cloud (Smart Things) to signal smart TVs.