Hadoop Admin

Future Focus Infotech Pvt. Ltd.
  • Kolkata
  • 2-4 lakh
  • 3-5 years
  • Views
  • 21 Dec 2017

  • IT/ Information Technology

  • IT/ Technology - Software/ Services
Job Description

- Ability to work with huge volumes of data so as to derive Business Intelligence.
- Strong knowledge of Linux/RHEL, shell scripting.
- Knowledge of high degree configuration management and automation tools like Puppet or Chef for non-trivial installation.
- Knowledge of cluster monitoring tools like Ambari, Ganglia, or Nagios.
- Good understanding of OS concepts, process management and resource scheduling.
- Knowledge of installing, configuring, maintaining and securing Hadoop and services of the Hadoop ecosystem.
- Hands-on experience in working with Hadoop Distribution platforms like HortonWorks, Cloudera, MapR and others.
- Knowledge of building Hadoop based services like HBase, Pig, Java and Hive.
- In-depth knowledge & experience with Hadoop ecosystem & architecture (including HDFS & YARN) across multiple distros.
Responsibilities -
- Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools, configuring the NameNode high availability and keeping a track of all the running hadoop jobs.
- Work closely with the database team, network team, Infra team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
- Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
- Knowledge of manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site.
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
- Backup and recovery tasks, Resource and security management.
- Troubleshooting application errors and ensuring that they do not occur again.
- Manage and maintain the Hadoop clusters for uninterrupted job.
- Routine check-up, back-up and monitoring of the entire system.

Competencies/Skill sets for this job

Hadoop Scripting Operating System Installing Big Data Hands-on

Job Posted By

Executive Delivery

About Organisation

Future Focus Infotech Pvt. Ltd.