Vijayashankar R

Data Engineer

Bengaluru, Karnataka, India7 yrs 9 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in deploying and managing Hadoop ecosystems.
  • Skilled in AWS and Azure cloud technologies.
  • Proven track record in real-time data processing.
Stackforce AI infers this person is a Data Engineer specializing in cloud-based data solutions and big data technologies.

Contact

Skills

Core Skills

Data EngineeringCloud Computing

Other Skills

AWSAWS GlueAmazon Web Services (AWS)Apache AirflowApache KafkaApache SparkApplication DevelopmentAzureAzure Data LakeAzure DatabricksData AnalyticsData PipelinesData ProcessingDelta LakeDelta Live Tables

About

I am a detail-oriented Data Engineer with a strong background in the Big Data ecosystem, dedicated to delivering high-quality solutions from inception to completion within dynamic teams. My expertise includes: Technical Skills: Proficient in Python, Informatica Oracle (SQL), Tableau, and Linux. Experienced in deploying and managing Hadoop ecosystems, including HDFS, Hive, Zookeeper, Kafka, Spark, and MapReduce. Cloud Proficiency: Skilled in leveraging AWS services such as S3, EMR, DynamoDB, Redshift, Glue, and Kinesis, as well as Azure technologies, including Databricks and Azure Data Factory. I hold two Azure Data Engineer certifications, underscoring my commitment to cloud-based data solutions. Integration and Workflow: Knowledgeable in Salesforce and MuleSoft for seamless data integration and API management. Experienced with Apache Airflow for orchestrating complex data workflows. Problem-Solving: Successfully solved 100+ LeetCode problems focused on Data Structures and Algorithms (DSA) using Python, demonstrating my strong analytical skills and coding proficiency. Project Leadership: Lead high-impact data module development, overseeing requirement analysis, estimation, planning, and execution. I facilitate inter-team coordination and ensure timely delivery of projects. Real-Time Data Processing: Expertise in capturing real-time data using Apache Kafka and transforming semi-structured streaming data into structured formats with Spark and Hive for future analysis. Client Engagement: Acted as the primary point of contact for clients on-site, fostering strong relationships and ensuring alignment with project goals. Analytical Skills: Strong troubleshooting, analytical, and problem-solving abilities, complemented by excellent communication and interpersonal skills. Agile Methodologies: Well-versed in Agile (Scrum) methodologies, enabling efficient project management and team collaboration. I am passionate about utilizing data engineering to drive business outcomes and continuously seek opportunities to enhance my skills and contribute to impactful projects.

Experience

Tata consultancy services

Data Engineer/ Analyst

Dec 2021Present · 4 yrs 3 mos · Bengaluru, Karnataka, India · Hybrid

PythonInformatica Oracle (SQL)TableauLinuxHadoopHDFS+12

Nxtlogic software solutions

Software Engineer

Nov 2018Nov 2021 · 3 yrs · Coimbatore, Tamil Nadu, India · Hybrid

Remmy substrates

System Engineer

Feb 2018Aug 2018 · 6 mos · Coimbatore, Tamil Nadu, India · On-site

Atom systems private limited

Application Developer Intern

Jun 2017Dec 2017 · 6 mos · Greater Coimbatore Area · On-site

Education

Anna University Chennai

Bachelor of Technology - BTech — Electronics and Communications Engineering

Jan 2013Jan 2017

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience