ISHITA VIRMANI

AI Researcher

Delhi, India12 yrs 10 mos experience
Most Likely To SwitchAI Enabled

Key Highlights

  • Architected petabyte-scale data platforms.
  • Achieved 4x performance gains with Trino.
  • Reduced AWS costs by 35% through optimization.
Stackforce AI infers this person is a Data Engineering Architect specializing in scalable data platforms and analytics.

Contact

Skills

Core Skills

Data Platform ArchitectureDistributed SystemsData GovernanceBig DataData Engineering

Other Skills

Lakehouse ArchitectureTrinoApache AirflowData SecurityApache SparkData AnalyticsData Pipeline DesignBig Data ProcessingHadoopData Systems EngineeringArtificial Intelligence FoundationsGenerative AILeadership DevelopmentSoftware DevelopmentAlgorithms

About

I architect and scale petabyte-scale data platforms that process billions of records daily, enabling high-performance analytics and business-critical decision-making. With 13+ years in data engineering, I’ve evolved from managing infrastructure to owning and designing end-to-end data platforms on AWS (S3, Spark, Trino) — optimizing both large-scale batch pipelines and low-latency ad-hoc analytics. At Info Edge, I currently lead data platform architecture and have: - Delivered a Trino-based query platform with 4x performance gains over Spark for ad-hoc workloads - Reduced query latency by 70–95% (p90–p95) and improved concurrency across the organization - Designed pipelines processing billions of records daily, ensuring scalability and reliability - Improved data retrieval performance by 50% through Lakehouse (Delta Lake) adoption - Reduced AWS infrastructure costs by 35% through optimized resource management - Led a PII data security & disaster recovery program, collaborating with 10+ cross-functional teams, mitigating multi-million-dollar risk - Enabled self-service analytics across teams, reducing dependency on engineering and accelerating decision-making My core areas of expertise include: - Data Platform & Lakehouse Architecture - Distributed Systems & Query Engine Optimization (Trino vs Spark) - Large-Scale Data Processing & Performance Tuning - Real-Time & Batch Pipeline Design - Data Governance, Security & Reliability

Experience

12 yrs 10 mos
Total Experience
4 yrs 3 mos
Average Tenure
8 yrs 4 mos
Current Experience

Info edge india ltd

Technical Architect, Data Engineering

Jan 2018Present · 8 yrs 4 mos · Noida Area, India

  • Own the architecture and evolution of a petabyte-scale data platform, driving platform strategy, roadmap, and adoption across the organization.
  • Defined and executed the data platform roadmap, enabling scalable systems that support 500+ business KPIs and power organization-wide analytics.
  • Built a custom distributed query platform using Trino on Zeppelin, enabling high-concurrency ad-hoc analytics
  • Introduced Apache Airflow, establishing standardized workflow orchestration and improving pipeline reliability and maintainability
  • Led PII data security and disaster recovery program for Data Platform, collaborating with 10+ cross-functional teams to strengthen compliance and mitigate multi-million-dollar business risk
  • Played a key role in shaping the data engineering function, mentoring engineers and driving adoption of best practices across the team
  • Enabled a self-service data ecosystem, empowering analysts and data scientists with seamless data access and reducing dependency on engineering
Data Platform ArchitectureLakehouse ArchitectureDistributed SystemsTrinoApache AirflowData Governance+1

Incedo inc.

Big Data Developer

May 2017Jan 2018 · 8 mos · Gurgaon, India

  • Processed multi-terabyte datasets using Spark, optimizing pipelines to reduce compute time by 50%, enabling faster delivery of analytics for a US pharmaceutical client.
Apache SparkBig Data ProcessingData AnalyticsBig Data

Hindustan times mobile solutions ltd.

Assistant Manager

Jul 2013May 2017 · 3 yrs 10 mos · Gurgaon, India

  • Transitioned from infrastructure management to engineering scalable Hadoop-based data systems, laying the foundation for enterprise data pipelines and improving system reliability.
HadoopData Systems EngineeringData Engineering

Education

Manav Rachna International University

Bachelor of Technology (B.Tech.) — Information Technology

Jan 2009Jan 2013

Stackforce found 100+ more professionals with Data Platform Architecture & Distributed Systems

Explore similar profiles based on matching skills and experience