Goutam Ghosh

Software Engineer

Bengaluru, Karnataka, India18 yrs 10 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Expert in architecting scalable data solutions.
  • Led cross-geographical teams in big data initiatives.
  • Improved data processing speed by 20%.
Stackforce AI infers this person is a Fintech Data Engineering expert with strong architectural and leadership skills.

Contact

Skills

Core Skills

JavaMicroservicesHadoopData EngineeringBig Data

Other Skills

Amazon Web Services (AWS)AngularJSApache AirflowApache KafkaApache OozieApache SparkCassandraElasticsearchHBaseHibernateHiveJava Enterprise EditionKibanaMachine LearningMapReduce

Experience

18 yrs 10 mos
Total Experience
3 yrs 1 mo
Average Tenure
5 yrs
Current Experience

Visa

Staff Software Engineer / Architect

Jun 2021Present · 5 yrs · Bengaluru, Karnataka, India

  • As a key figure in VISA's Data and AI team, I specialize in crafting robust architectures and delivering core platforms like Data Infrastructure, Visualization tools, ML Platform, Customer solutions, and AI products to empower VISA's business teams.
  • Leading and mentoring a dispersed team overseeing critical Authorization and Settlement components, we manage 7 petabytes, handling 1.1 million daily queries. I contributed to designing, coding, and deploying a data engineering solution, using Spark, Hadoop, HBase, and Splice-Machine, improving data processing speed by 20%.
  • I architected a Common Data Infrastructure Service platform for VISA's apps, using REST, Spring Boot, Java, and Scala. Handling 12 million daily requests, it showcases expertise in Backend (Java, microservices) and Frontend (Spring, React) technologies. I mentored support teams for effective maintenance.
  • Collaborating with Product Owners and Managers, I prioritize operational excellence, translating business needs into technical solutions. I lead a 3-year Technology Road Map, evaluating GCP Spanner, YugaByte, and Azure, and comparing them to next-gen tech stacks like YugaByte and CockroachDB.
  • Owning the platform for Transactional and operational data, I ensure scalability for thousands of daily requests, emphasizing architectural foresight. I streamlined onboarding, boosting efficiency by 40%, reflecting our commitment to operational excellence.
JavaApache KafkaHadoopMicroservicesApache AirflowPython (Programming Language)+8

Iqvia

Senior Application Developer

Oct 2017Jun 2021 · 3 yrs 8 mos · Bengaluru, Karnataka, India

  • Part of Advanced Engineering Team, Leading team of engineers Working on new age solution for IQVIA using Big Data Tools and Technologies.
  • Designed and developed Scala & Apache Spark based schema parsing, change data capture etc. Developed functionalities using various spark APIs like DataFrames, DataSets and RDDs.
  • Developed various re-usable Spark & Scala code components to be used across different modules. Some examples are Data Reader & Writers Factories JDBC operations, Implicit Class for reusable Dataframe/Dataset functions.
  • Successfully leading & managing cross geographical teams in various IQVIA Analytical platform initiatives impacting the IQVIA Canada region.
  • Working closely together with global tech, business and data science teams to develop new ideas, implement and test them, and measure success.
  • Contributes design, code, configurations, and documentation for components that manage data
  • ingestion, real time streaming, batch-processing, data extraction, transformation.
  • End to End Design & development of Data platform for building a Consumer space portfolio for IQVIA..
  • Performance tuning the application to bring down the execution time.
  • Cross-trains other team members on technologies being developed, while also continuously learning new technologies.
MicroservicesREST APIsBig Data

Impetus

Lead Engineer

Sep 2015Oct 2017 · 2 yrs 1 mo · Bengaluru, Karnataka, India

  • Architect cum Lead a team of 6+ people in various Impetus Data Engineering initiatives .
  • Lead a team to implement the Business logic for a Recommendation Engine in Spark and Elastic Search.
  • Implement the Web Services and provide the demographics data in json format to the UI team.
  • Investigated problems in production and make changes to the environment and associated applications as required.
  • Played a crucial role in implementing PAAS strategy for on-premise cloud using OpenStack and Myriad

Siemens technology india

Associate Consultant

Oct 2013Sep 2015 · 1 yr 11 mos · Kolkata, West Bengal, India

  • Leading a team to investigate big data technologies like Hadoop,hive,sqoop,pig etc relevant to product's need.
  • Work closely with Product Management teams during design and development phases to ensure they meet requirements for scalability, reliability, performance, and manageability.
  • Investigate problems in production and make changes to the environment and associated applications as required.
  • Working closely with Functional Team to support finalizing specification design document.
  • Work closely with different development teams across geographies to deliver enhanced features for the product suite.

Wipro limited

Technical Leader

Feb 2012Oct 2013 · 1 yr 8 mos · Kolkata, West Bengal, India

  • Interfacing with client for requirement gathering, finalizing technical specifications for the product.
  • Understanding existing architecture and impart knowledge and training across teams.
  • Preparing Functional Specification and Design Specification for new features using use case diagrams,Class diagrams and sequence diagrams
  • Participating in design discussions and analyze the problem in detail to understand the key points.
  • Ensuring smooth implementation and testing of the application.
  • Mentor junior team members.
  • Implementing services catering to the requirement of different teams
  • Updating and enhancing existing build and deployment scripts to increase automation and efficiency and reduce errors
  • Making sure on a daily basis that none of the critical application cycles are delayed.
  • Address any failure immediately and resolve within SLA.
  • Come up with plan so that resolution time decreases over a period of time.

Cognizant technology solutions

Associate-Projects

Aug 2007Feb 2012 · 4 yrs 6 mos

  • Part of the core architecture team played a critical role in development of the UI Framework using GWT
  • Participated in code review sessions for the code developed by other teams
  • Have worked in a client interfacing role ensuring no gap exists between onsite and offshore teams
  • Provided consultation to development teams.
  • Developed Functional Design, Technical Design, Test case documents and Operation Manual
  • Developed enhanced UI framework using JSF
  • Played a vital role in SIT, UAT and Market Acceptance Testing.
  • Provided functional knowledge to new team members at onsite and offshore.
  • Making sure on a daily basis that none of the critical application cycles are delayed.
  • Address any failure immediately and resolve within SLA.

Education

RCC IIT

Bachelor in Engineering — Information Technology

Stackforce found 100+ more professionals with Java & Microservices

Explore similar profiles based on matching skills and experience