Aakash Choudhary

Software Engineer

Hoshangabad, Madhya Pradesh, India11 mos experience

Key Highlights

Developed automated ML deployment pipelines on Azure Databricks.
Reduced false positives by 35% in fraud detection analytics.
Improved data processing efficiency by 30% through optimized workflows.

Stackforce AI infers this person is a Data Engineering professional specializing in scalable data platforms and real-time analytics.

Contact

Skills

Core Skills

Apache SparkEtlData Validation

Other Skills

AWS GlueAWS LambdaAirflowAmazon AthenaAmazon KinesisAmazon RedshiftAmazon S3Amazon Web Services (AWS)Analytical SkillsApache KafkaAzure Data FactoryAzure DatabricksBig DataCloud ComputingData Quality

About

I’m a Software Engineer passionate about building scalable data platforms and real-time analytics systems. With hands-on experience in Apache Spark, Databricks, and Azure/AWS, I specialize in designing ETL pipelines, streaming architectures, and Lakehouse solutions that power data-driven decision-making. At ThoughtGenesis, I developed and automated large-scale data workflows using Spark, Airflow, and Terraform, improving performance and reducing manual deployment efforts by over 60%. My work bridges data engineering and analytics, enabling reliable, high-throughput data systems for business insights. I’ve led end-to-end projects like: ⚙️ Real-Time Personalized Recommendation Lakehouse – Built a lakehouse architecture on Azure Databricks with CI/CD pipelines for automated ML deployment. 🛡️ Fraud Detection & Analytics Platform – Implemented streaming ETL pipelines and Power BI dashboards for real-time anomaly detection, reducing false positives by 35%. I thrive in collaborative, agile environments, where problem-solving, adaptability, and technical rigor meet business impact. Core Skills: Spark | Scala | Python | Azure | Databricks | Kafka | Airflow | Data Modeling | ETL | Lakehouse Architecture | CI/CD | Terraform Certifications: ☁️ AWS Cloud Practitioner (2025) | Microsoft Certified: Azure Data Engineer (2025)

Experience

Thoughtgenesis

2 roles

Software Engineer

Jun 2022 – Feb 2023 · 8 mos · Hyderabad, Telangana, India

Developed and deployed Scala-based data validation pipelines to identify and correct inconsistencies in large datasets.
Built and optimized Spark-based ETL workflows, improving data processing efficiency and reducing runtime by 30%.
Ingested and processed OpenStreetMap (OSM) data through end-to-end pipelines, including cleaning, validation, and deduplication.
Migrated existing code from ReactorX to Scala, ensuring better performance and maintainability.
Collaborated with cross-functional teams to maintain data quality standards and resolve complex data issues.
Worked with tools like Hadoop, Git, Docker, and Kubernetes for scalable and containerized data processing.

Apache SparkScalaETLAirflowTerraformHadoop+3

Software Engineer Intern

Mar 2022 – Jun 2022 · 3 mos · Hyderabad, Telangana, India

Completed hands-on training in Scala, Hadoop, and distributed data systems, applying them to build batch-oriented ETL pipelines for real-world use cases.
Conducted schema validation and anomaly detection on internal Apple datasets, ensuring data consistency and integrity across transformation stages.
Designed and implemented Scala-based data validation pipelines to automate the identification and correction of inconsistencies.
Integrated validation pipelines into batch workflows, significantly improving pipeline reliability and maintainability.
Gained practical experience in big data processing, collaborating with engineers to align data standards and improve overall data quality.

ScalaHadoopETLData Validation