Sowmya K. — Data Engineer

Senior Data Engineer | AI Data Engineer | Big Data & Cloud EngineerData Engineer with 9+ years of experience building and optimizing large scale data platforms across distributed systems and cloud environments. I specialize in designing reliable data pipelines, improving performance of large data workflows, and building scalable data infrastructure that supports analytics and product decision making. At Meta, I’ve been exploring how AI can enhance the way data engineers work. By integrating AI assisted development into my workflow, I’ve been able to simplify pipeline development, improve code quality and reduce debugging time by nearly 70%. What excites me most about the current evolution of data engineering is how AI can accelerate experimentation, learning and problem solving. With the right prompts and approach, it becomes a powerful partner for engineers building complex systems. Throughout my career, I’ve also learned how to quickly adapt to new teams, systems and domains. I focus on understanding existing architecture first, building strong relationships with stakeholders and then gradually improving reliability, performance and scalability. I believe great engineering comes down to curiosity, resilience and consistency. I may not know everything on day one, but I will always put in the effort to figure things out and keep improving. My Core Expertise: 🛠️ Data Ingestion: Sqoop, Kafka, Flume 📊 Data Processing: Hadoop, MapReduce, Pig, Spark💻 Programming Languages: Java, Scala, Python, R, SQL 📂Databases/DataWarehouses: Hive, Impala, Hbase, BigQuery,Oracle, MySQL, Postgres, Teradata, Greenplum, NoSQL, MongoDB,Cassandra,Snowflake, Redshift, Athena, RDS, Elastic Search, DynamoDB 📆 Schedulers/Version Management: Oozie, Jenkins, GIT, Automic,AirFlow 📊 Data Visualization: Tableau, Power BI ,Mode , Quiksight ☁️ Cloud: AWS , Azure, Google Cloud🔄 ETL & ELT: Nifi, Streamsets,SSIS ,DBT 📜Misc: Unix Shell Scripting, MSBI (SSAS, SSMS, SSRS), HTML, CSS,Android, JIRA , Docker , Googling , Terraform , Kubernetes , GitHub Actions , Claude

Stackforce AI infers this person is a Big Data and Cloud Engineering expert with a strong focus on AI-driven solutions.

Location: London, United Kingdom

Experience: 9 yrs 6 mos