Kamran Ali

VP of Engineering

Gurgaon, Haryana, India14 yrs experience
Highly Stable

Key Highlights

  • Over 11 years of experience in data engineering.
  • Led multiple teams to deliver complex data platforms.
  • Proficient in Python and cloud technologies.
Stackforce AI infers this person is a Data Engineering expert in SaaS with extensive experience in cloud and data integration.

Contact

Skills

Core Skills

Data EngineeringData WarehousingSoftware Development

Other Skills

AWSAWS CloudFormationAWS LambdaAlgorithmsAmazon Elastic MapReduce (EMR)Amazon Web Services (AWS)Apache AirflowApache KafkaApache SparkApache Spark StreamingApache StormBig DataBooking ServicesC (Programming Language)C++

About

Hi, I'm Kamran Ali. I have ~11.5 years of experience in Designing and Building Transactional / Analytical Systems. I'm actually getting paid while pursuing my Hobby and its already been a decade. In my next decade, I'm looking forward to guide and mentor engineers with experience and resources For FREE engineering advice, resources and opinions visit my blog http://atech.guide and FOLLOW me on LinkedIn

Experience

Atlassian

2 roles

Senior Engineering Manager

Promoted

Oct 2024Present · 1 yr 5 mos · Remote

Principal Engineer

Oct 2023Jan 2025 · 1 yr 3 mos · Remote

  • In Atlassian, I led the Transform team of 6 Engineers (Jr to Sr Engineers) as DRI (Directly Responsible Individual).
  • We primarily contributed in the re-built of an opinionated Data Platform.
  • Details on https://www.atlassian.com/blog/atlassian-engineering/evolve-your-data-platform-with-a-deployment-capability blog.
  • As a team, we shipped following Capabilities from Jan, 24 till June, 24,
  • 1. Backfill Capability for Data Pipeline
  • 2. Run Once Capability for Data Pipeline
  • 3. DBT Filter support for Data Pipeline
  • 4. Pipeline Level Dependencies
  • 5. CatchUp Capability for Data Pipeline
  • 6. Depends On Past Capability for Data Pipeline
  • 7. User secret management
  • 8. DBT Python Transform Capability
  • 9. Data Migration (from old lake to new lake)
  • 10. Trigger Tableau for Data Refresh
  • 11. Flow Step and Subgraph Step level dependency
  • 12. DBT SQL Transform Capability in FedRAMP
  • In that period, I reviewed and approved 9 Design Documents spanning across multiple capabilities.
  • Wearing Deep Engineer hat, I also Designed, Coded and Delivered the MVP of Python Ingest Capability which is Crucial for nuanced Ingestion use cases.
  • During development, we ran multple experiments to finalize on a scalable approach collaborating with internal and external stake holders.
Data PlatformPythonDBTData PipelineUser secret managementData Engineering+1

Godaddy

Principal Data Engineer

Jul 2022Sep 2023 · 1 yr 2 mos · India · Hybrid

  • Brand Data Integration
  • Working on integrating the data of brands acquired by GoDaddy into the Central Data Platform. During the integration, proposed, architected and building a Python Library to simplify the integration for upcoming similar projects
  • Articles
  • Co authored a blog on "Layered Architecture for a Data Lake"
  • Ref: https://www.godaddy.com/resources/news/layered-architecture-for-a-data-lake
PythonData IntegrationCentral Data PlatformData Engineering

Expedia group

4 roles

Senior Data Engineer

Jun 2020Jul 2022 · 2 yrs 1 mo

  • Re Architecting Streaming Workflows
  • With an aim of simplifying and modernizing the Streaming tech stack participated in exploring streaming technologies, creating comparison documentation, and a migration plan.
  • Tech Stack: Java, K Streams, Springboot
  • Hotel Confirmation Email Enhancements
  • Worked on enhancing the Hotel Confirmation Email to provide traveler's information about the health and safety measurements that the hotel has implemented. We further improved the customer experience by providing the information about the money he saved by booking an Hotrate hotel
  • Tech Stack: Java, Apache Storm
  • Same Day Price Drop Notification
  • Worked on Same Day Push Notification for Car, where we have to trigger the Push Notification when the price of the Car that customer originally looked at has reduced by X% within the same day of their search but customer haven't booked it
  • Tech Stack: Java, Apache Storm
JavaApache StormStreaming TechnologiesData Engineering

Software Development Engineer 2 (Big Data Engineer)

Promoted

Sep 2018Jun 2020 · 1 yr 9 mos

  • Building Streaming Pipelines
  • Currently involved in building a streaming Data pipeline using Apache Spark Structured Streaming, Scala, Cassandra, and AWS Technologies like EMR. This will be utilized in running the Pricing algorithms at scale and near real-time.
  • Migration between AWS Account
  • Designed and Lead the migration of apps/resources between AWS accounts. Initially, we had our stack on a common AWS account, and then as per company policy, we have to move it to a different one.
  • 3PI Price Algorithm
  • Design, coded, and delivered the 3PI price algorithm on Apache Spark which increases the pricing competitiveness of 3PI inventory. We are using enhancement techniques on data points, allowing Expedia to propose competitive 3PI rates.
  • Pricing Algorithm
  • Coded the pricing algorithm on Apache Spark, that will make sure consumer will benefit from the cheapest price while not undercutting hotel prices, enforcing the new strategy proposed and developed by Expedia Group
  • Multi-Tier Cancellation
  • Lead the effort to design, build, test and deliver multi-tiered cancellation policy support for suppliers in Booking Stack. Suppliers can now support multiple windows with different cancellation rules for a booking which improves customer experience and provides more fine-grain control over financials.
  • Partner Onboarding
  • Participated in designing and building booking, post-booking and async notification support for newly onboarded partners. Async Notification support increases booking success percentage which prevents dollar loss and a better customer experience
Apache SparkScalaAWSData Engineering

Software Development Engineer I

Promoted

Mar 2016Aug 2018 · 2 yrs 5 mos

  • Harnessing my potential in breaking monolithic codebase into microservices and containerized cloud deployments.
  • Booking Stack Migration
  • Involved in designing and migration of billion-dollar booking stack from monolithic chunk to microservices. Worked on the design and development of domain service including performance testing, traffic migration, statistical comparisons. The success rate is ~.72% better in new stack and the success rate of post-booking retrieval is 99.98% which constitutes 49% of entire traffic on booking servers.
  • Cloud Migration
  • With the aim of achieving elasticity of servers and granular investment tracking of infrastructure, participated in making domain services cloud-native and their migration from the data center to AWS. Focussing on hybrid stage challenges e.g. latencies between datacenter and cloud.
  • Distributed Caching
  • To avoid fetching static data from Relational DB while booking the hotel. Proposed, Designed, and Delivered production-ready Redis Cluster. TP99 of data retrieval is ~3ms. Currently serving as SME on the solution.
  • Fraud Suspect Booking Handling
  • Designed and delivered a cloud-native solution to clear Fraud Suspect Hotel Bookings. Booking is either canceled or marked as legitimate within a specified duration. Partners are then notified for legitimate bookings.
JavaMicroservicesCloud MigrationSoftware Development

Associate Software Development Engineer

May 2014Mar 2016 · 1 yr 10 mos

  • As a JAVA backend developer in the largest travel booking company.I've worked on following JAVA Web Services and features:
  • Booking Search:
  • Provided solution to partners to search for booking in their hotel chain based on customer details through RESTFul API. This feature ranks top based on its usability. Delivered concept-to-completion web service in <7 months getting a live traffic of ~10TPS. Played crucial role in CI-CD pipeline, preparing build script and load testing.
  • Booking confirmation feature:
  • Extended Booking Search to add confirmation API, which acts as an acknowledgement of booking. Hence enables us to track that partners are aware of booking done in their hotel. Delivered from scratch in two weeks facing live traffic of ~1TPS.
  • Reconciling Bookings:
  • Reduced call center volumes and manual work by providing RESTFul API enabling partners to edit bookings as per change in customer stay. Finalized the design and delivered MVP in ~2 months facing live traffic of ~5TPS.Later proposed and delivered RESET functionality, which nullify all changes that have been made on a booking. Thus helps in reverting back erroneous updates on the booking.
JavaRESTful APIBooking ServicesSoftware Development

Samsung r&d institute india-delhi

2 roles

Software Engineer II

Promoted

May 2013Apr 2014 · 11 mos · Noida, Uttar Pradesh, India

  • As a C++ developer in Samsung Research India.I've worked on following:
  • Studying life cycle of Samsung Apps on Smart TV.
  • Checked app compatibilities while porting to new display engine
  • Analysed and provided solutions for crashes while studying the underline webkit engine
C++Smart TV Applications

Software Engineer

Jul 2012Apr 2013 · 9 mos · Noida, Uttar Pradesh, India

  • As a C++ developer in Samsung Research India.My roles and responsibilities were:
  • Studying the display of GUI components on smart TV.
  • Analysed performance improvements while porting GUI library under the wrapper
  • Support to market issues.
C++GUI Components

Ieee student branch manit

Chairman

Jul 2011Feb 2012 · 7 mos · Greater Bhopal Area

  • Joint Secretary at SCEECS 2012:
  • Started a initiative to teach underprivileged kids- Aarambh
  • Multiple workshops were conducted for each branch (Computer Science, Electronics, electrical)

Linux solutions

Software Engineering Intern

May 2011Jun 2011 · 1 mo · Greater Bhopal Area

  • Training done in Linux System & Network Administration

Education

Maulana Azad National Institute of Technology

Bachelor of Technology (B.Tech.) — Computer science and Engineering

Jan 2008Jan 2012

vandana convent school

High School/Secondary Diplomas and Certificates

Jan 1994Jan 2007

Stackforce found 100+ more professionals with Data Engineering & Data Warehousing

Explore similar profiles based on matching skills and experience