Abhijit Singh

CEO

Bengaluru, Karnataka, India19 yrs experience

Highly Stable

Key Highlights

19 years of experience in diverse technology domains.
Expert in designing scalable Big Data solutions.
Proven track record in cost optimization initiatives.

Stackforce AI infers this person is a Big Data and Cloud Computing Architect with extensive experience in SaaS and Data Engineering.

Contact

Skills

Core Skills

Big DataCloud ComputingData EngineeringDistributed Systems

Other Skills

AJAXAWSAgile MethodologiesAmazon EMRAmazon Web Services (AWS)Apache KafkaApache MesosApache SparkApache StormCore JavaData StructuresDatabricksDebeziumDropwizardDruid

About

As a Software Architect (L7) at CommerceIQ, I lead the Platform Engineering team and design and develop large scale Big Data solutions using open sources, cloud computing, managed services and agile methodologies. I have over 19 years of experience in the E-Commerce, Mobility, SaaS, VAS and Telecom domains, with primary skills in Big Data, Cloud Computing, backend Platforms and Java/J2EE technologies. I also hold a PG Diploma in Machine Learning and Artificial Intelligence from IIIT Bangalore, and I am a student mentor for Big Data courses. I am passionate about solving complex business problems using data-driven approaches and leveraging the latest technologies and frameworks. My mission is to deliver high-quality, reliable, and scalable products that empower our customers and partners to grow their businesses.

Experience

19 yrs

Total Experience

2 yrs 8 mos

Average Tenure

2 yrs 9 mos

Current Experience

Commerceiq

Software Architect

Sep 2023 – Present · 2 yrs 9 mos · Bengaluru, Karnataka, India · Hybrid

Leading technical leadership in platform engineering across multiple platforms including Crawler Platforms, Data Platforms, and DataBricks Compute Platforms.
Migrating crawler platforms from GCP to AWS. This also includes unification of 3 different crawler platforms (~80M crawls/day across ~1K retailers).
Involved in senior leadership hiring (VP, Directors, Architects) for key engineering roles resulting in a high-performing team.
Achieved ~35% cost reduction in 2024 through cost optimization initiatives.
Migrated 100TB data from SnowFlake to DataBricks.
Lead the architecture of a new unified Data Platform.

DatabricksApache SparkAmazon Web Services (AWS)Performance TuningGoogle Cloud Platform (GCP)Big Data+1

Api holdings

2 roles

Principal Architect ( Data Engineering )

Apr 2021 – Sep 2023 · 2 yrs 5 mos · Hybrid

Leading Data Engineering at API Holdings / PharmEasy.
Primarily involved in Design and Architecture of Big Data Platform.
Tech stacks & service : Amazon EMR, Spark, Hudi (Lakehouse), Debezium, Druid, etc
Data Quality, Data Profiling, Data Auditor
Tech hiring

Distributed SystemsAgile MethodologiesAmazon Web Services (AWS)Big DataTechnical LeadershipData Engineering

Sr Architect ( Data Engineering )

Aug 2018 – Mar 2021 · 2 yrs 7 mos · Hybrid

Heading the Data Engineering team at API Holdings / PharmEasy.
Primarily involved in Design and Architecture of Big Data Platform.
Hiring and managing the core team.
Involved in setting up the infra, monitoring, and alerting stack. The Data Platform has been built using AWS, HDP Ambari, Qubole, Spark, kafka, Redshift, Kubernetes, StatsD, InfluxDB, Chronograf
Built Batch Processing pipelines, ETL & CDC pipelines, Data Lake, Data Warehousing.
Currently working on Real time data / Stream processing.

Distributed SystemsAgile MethodologiesAmazon Web Services (AWS)Big DataTechnology LeadershipData Engineering

Mentorkonnect

Student Mentor (Big Data)

Mar 2021 – Aug 2023 · 2 yrs 5 mos · Bangalore Urban, Karnataka, India

Upgrad

SME ( Consultant Big Data )

Jan 2019 – Jan 2019 · 0 mo

Ola (ani technologies pvt. ltd)

Principal Engineer

Apr 2017 – Aug 2018 · 1 yr 4 mos · Bengaluru, Karnataka, India

Worked on an Org level initiative : 'Kafka As A Service' (KaaS). Authentication, Authorisation, Quota management, Metric Centre, Config Management, KaaS Client , multi-tenancy are some of the key features of 'KaaS'. Contributed to architecture and design of in house built tools like Data Auditor / Profiler, and Notification As a Service.
Built an ETL (CDC- Change data capture) pipeline called 'Foster' as a DataPlatform initiative. 'Foster' drives data lakes, and data marts in DataPlatform. Key components includes open sources like Secor, Maxwell, and Kafka along with in house built Meta Service, UI, Snapshot (De-duplication and Reconciler), and Config Service. The pipeline runs on AWS with data residing in S3. Hive tables built on top of the Snapshot data is consumed by Data Analysts.

Flipkart

SDE II

Jul 2014 – Mar 2016 · 1 yr 8 mos · Bangalore

Worked as a software developer on the big data stack. Technology stack included Java and Big data technologies like Hadoop, Apache Kafka, Apache Storm, Hive, etc.

Onmobile global limited

4 roles

Associate Engineering Manager

Promoted

Apr 2014 – Jun 2014 · 2 mos

Engineering Lead

Apr 2012 – Mar 2014 · 1 yr 11 mos

Leading the Campaign Management team for OnMobile. Basically worked on Voice and Text(SMS, USSD) based campaign management platforms. Technology stack included Java / J2EE, and Big data. Worked on frameworks like Spring, Hibernate, Struts, etc.

Senior Software Engineer

Promoted

Aug 2009 – Mar 2012 · 2 yrs 7 mos

Working on JMX - Java Management Extensions, Spring and Hibernate

Software Engineer

Aug 2008 – Jul 2009 · 11 mos

Worked on Mobile Paparazzi App that assisted users to upload their pictures and videos on social networking sites like Facebook, YouTube, Daily motion, Flickr, etc.