Jul 2014 – Jan 2019 · 4 yrs 6 mos · Milwaukee, Wisconsin, United States

• Did architect, design, installation, configuration and management of Apache Hadoop, Hortonworks Distribution.
• Set up automated processes to analyze the System and Hadoop log files for predefined errors and send alerts to appropriate groups.
• Handle the installation and configuration of a Hadoop cluster.
• Build and maintain scalable data pipelines using the Hadoop ecosystem and other open source components like Hive and HBase.
• Handle the data exchange between HDFS and different Web Applications and databases using Flume and Sqoop.
• Monitor the data streaming between web sources and HDFS.
• Worked in Kerberos and how it interacts with Hadoop and LDAP.
• Worked on Kafka distributed, partitioned, replicated commit log service and provides the functionality of a messaging system.
• Involved in close monitoring and analysis of the Map Reduce job executions on cluster at task level.
• Commissioned and Decommissioned the Hadoop nodes & Data Re-balancing.
• Gave inputs to development regarding the efficient utilization of resources like memory and CPU utilization based on the running statistics of Map and Reduce tasks.
• Involved in software intermediary that makes it possible for application programs to interact with each other and share data.
• Worked extensively with Amazon Web Services and Created Amazon Elastic Map Reduce cluster in both 1.0.3 and 2.2.
• Worked in Kerberos, Active Directory/LDAP, Unix based File System.
• Presented Demos to customers how to use AWS and how it is different from traditional systems.
• Involved in implementation of REST that exposes specific software functionality while protecting the rest of the application in API.
• Experience in Nagios and writing plugins for Nagios to perform the multiple server checks.
• Did changes to the configuration properties of the cluster based on volume of the data being processed and performance of the cluster.
• Set up Identity, Authentication, and Authorization.

Jun 2013 – Jul 2014 · 1 yr 1 mo · Bengaluru, Karnataka, India

• Installed and configured Hadoop and responsible for maintaining cluster and managing and reviewing Hadoop log files.
• Worked in a fully managed peta byte-scale data warehouse service and it is designed for analytic workloads and connects to standard SQL-based clients and business intelligence tools in Red shift.
• Involved in architecture, designed, installation, configuration and management of Apache Hadoop, Hortonworks Distribution Platform (HDP).
• Worked in delivers fast query and I/O performance for virtually any size dataset by using columnar storage technology and parallelizing and distributing queries across multiple nodes in Red shift.
• Worked on Storm its distributed real-time computation system provides a set of general primitives for doing batch processing.
• Experience in Horton works Distribution Platform(HDP)cluster installation and configuration.
• Experience in Kerberos, Active Directory/LDAP, Unix based File System.
• Load data from various data sources into HDFS using Flume.
• Worked in statistics collection and table maintenance on MPP platforms.
• Worked on Cloudera to analyze data present on top of HDFS.
• Worked extensively on Hive and PIG.
• Worked on Kafka distributed, partitioned, replicated commit log service and provides the functionality of a messaging system.
• Worked on spark it’s a fast and general –purpose clustering computing system.
• Wrote code in Python or Shell Scripting.
• Involved in Source Code Management tools and proficient in GIT, SVN, Accurev.
• Involved in Test Driven Development and wrote the test cases in JUnit.
• Worked on large sets of structured, semi-structured and unstructured data.

Jan 2012 – May 2013 · 1 yr 4 mos

• End to end involvement of Installation, Patching, Cloning, Upgrade, Autoconfigure, AD Utilities, Platform Migration and NLS Implementation.
• Applied patches to the 11i and R12 instance.
• Involved in setting up cron jobs for monitoring the database.
• Did Installation of E-Business suit R12 for the Dev/UAT/CRP1 instance.
• Did Installation of Single node/ Multi node on Linux, Solaris
• Involved in Reconstruction of databases in development environment.
• Involved in Installation of software, creation databases and decommission of databases.
• Upgrade the databases and applied patches.
• Managed the tablespaces (adding, resizing the tablespaces).
• Checked CRON Jobs and rescheduling process and monitoring.
• Created the users and gave necessary privileges as per the application request.
• Hands on involvement in administration of RAC databases.
• Involved in cluster failure issue in RAC environment.
• Performed reorganization of tablespaces and refresh of databases.
• Improved the db. Performance, reconstructed a critical database.
• Renamed the users as per the application users request.
• Generated the AWR and stats pack reports to diagnose the database performance.
• Managed the export, hot and RMAN backups.
• Implemented backup/restore procedures in ARCHIVELOG mode
• Knowledge on administration of RAC databases.
• Involved in cluster failure issue in RAC environment.
• Performed reorganization of tablespaces and refresh of databases.
• Improved the db performance, reconstructed a critical database.
• Involved in renaming the users as per the application users request.
• Generated the AWR and stats pack reports to diagnose the database performance.
• Managed the export, hot and RMAN backups.

Jun 2011 – Jan 2012 · 7 mos · Bengaluru, Karnataka, India

• Installed and upgraded OE & Red hat Linux and Solaris 8/9/10 x86 & SPARC on Servers like HP DL 380 G3, 4 and 5 & Dell Power Edge servers.
• Involved in LDOM’s and Creating sparse root and whole root zones and administered the zones for Web, Application and Database servers and worked on SMF on Solaris 10.
• Worked in AWS Cloud Environment like EC2 & EBS.
• Implemented and administered VMware ESX 3.5, 4.x for running the Windows, Centos, SUSE and Red hat Linux Servers on development and test servers.
• Installed and configured Apache on Linux and Solaris and configured Virtual hosts and applied SSL certificates.
• Implemented Jumpstart on Solaris and Kick Start for Red hat environments.
• Worked with HP LVM and Red hat LVM.
• Implemented P2P and P2V migrations.
• Involved in Installing and configuring Centos & SUSE 11 & 12 servers on HP x86 servers.
• Implemented HA using Red Hat Cluster and VERITAS Cluster Server 5.0 for Web Logic agent.
• Managed DNS, NIS servers and troubleshooting the servers.
• Troubleshoot application issues on Apache web servers and database servers running on Linux and Solaris.
• Involved in migrating Oracle, MYSQL data using Double take products.
• Used Sun Volume Manager for Solaris and LVM on Linux & Solaris to create volumes with layouts like RAID 1, 5, 10, 51.
• Re-compiled Linux kernel to remove services and applications that are not required.
• Performed performance analysis using tools like prstat, mpstat, iostat, sar, vmstat, truss, Dtrace.
• Worked on LDAP user accounts and configuring ldap on client machines.
• Used HP Service center and change management system for ticketing.
• Worked on the administration of the Web Logic 9, JBoss 4.2.2 servers including installation and deployments.
• Worked on F5 load balancers to load balance and reverse proxy Web Logic Servers.
• Used Shell scripting to automate the regular tasks like removing core files, taking backups of important