ISHITA VIRMANI — AI Researcher
I architect and scale petabyte-scale data platforms that process billions of records daily, enabling high-performance analytics and business-critical decision-making. With 13+ years in data engineering, I’ve evolved from managing infrastructure to owning and designing end-to-end data platforms on AWS (S3, Spark, Trino) — optimizing both large-scale batch pipelines and low-latency ad-hoc analytics. At Info Edge, I currently lead data platform architecture and have: - Delivered a Trino-based query platform with 4x performance gains over Spark for ad-hoc workloads - Reduced query latency by 70–95% (p90–p95) and improved concurrency across the organization - Designed pipelines processing billions of records daily, ensuring scalability and reliability - Improved data retrieval performance by 50% through Lakehouse (Delta Lake) adoption - Reduced AWS infrastructure costs by 35% through optimized resource management - Led a PII data security & disaster recovery program, collaborating with 10+ cross-functional teams, mitigating multi-million-dollar risk - Enabled self-service analytics across teams, reducing dependency on engineering and accelerating decision-making My core areas of expertise include: - Data Platform & Lakehouse Architecture - Distributed Systems & Query Engine Optimization (Trino vs Spark) - Large-Scale Data Processing & Performance Tuning - Real-Time & Batch Pipeline Design - Data Governance, Security & Reliability
Stackforce AI infers this person is a Data Engineering Architect specializing in scalable data platforms and analytics.
Location: Delhi, India
Experience: 12 yrs 10 mos
Skills
- Data Platform Architecture
- Distributed Systems
- Data Governance
- Big Data
- Data Engineering
Career Highlights
- Architected petabyte-scale data platforms.
- Achieved 4x performance gains with Trino.
- Reduced AWS costs by 35% through optimization.
Work Experience
Info Edge India Ltd
Technical Architect, Data Engineering (8 yrs 4 mos)
Incedo Inc.
Big Data Developer (8 mos)
Hindustan Times Mobile Solutions Ltd.
Assistant Manager (3 yrs 10 mos)
Education
Bachelor of Technology (B.Tech.) at Manav Rachna International University