Lead - Hadoop Developer

Talenture Management Consulting
  • Chennai
  • 15-20 lakh
  • 10-15 years
  • Views
  • 21 Mar 2017

  • IT/ Information Technology

  • IT/ Technology - Software/ Services
Job Description

The ideal candidate will be responsible for administration of the Hadoop software, and ensure that the Hadoop infrastructure is implemented using best practice taking into account our strategic architectural roadmap which this individual will help to develop. The Hadoop Engineer will work closely with the big data users, developers and server admin teams.

The ideal candidate will ensure that: systems function within defined SLA, outages are addressed rapidly and efficiently, upgrades and enhancements are non-disruptive and appropriate future planning is performed and acted upon.

Responsibilities :

- Deploy and manage scalable Hadoop cluster environments.

- Hadoop Core Components & Environment Administration Hive, Job Tracker, Task tracker, Pig, Scoop, Flume etc.

- All Functions like Monitoring Cluster & Jobs, troubleshooting, user onboarding, reporting application status, Incident & Outage Management.

- Manage the backup and disaster recovery for Hadoop data.

- Optimize and tune the Hadoop environments to meet performance requirements.

- Install and configure monitoring tools.

- Work with big data developers and developers designing scalable supportable infrastructure.

- Be the SME on Hadoop, HBase and other Hadoop ecosystem components and related tools.

- Work with Linux server admin team in administering the server hardware and operating system

- Assist with management of formal system runbooks.

- Create and publish various production metrics including system performance and reliability information to systems owners and management.

- Perform ongoing capacity management forecasts including timing and budget considerations.

- Coordinate root cause analysis (RCA) efforts to minimize future system issues.

- Mentor, develop and train junior staff members as needed.
- BS Degree in Computer Science/Engineering required.

- 10+ years of IT experience

- 5+ years overall experience in Linux systems.

- 2+ years of experience in deploying and administering Hadoop Clusters

- Well versed in installing & managing distributions of Hadoop (Hortonworks, Cloudera etc.)

- Knowledge in performance troubleshooting and tuning Hadoop Clusters

- Good knowledge of Hadoop cluster connectivity and security.

- Linux System Admin Knowledge, understanding of Storage, Filesytem, Disks, Mounts, NFS, VIP

- Development experience in Hive, PIG, Sqoop, Flume, and HBASE desired

- Excellent customer service attitude, communication skills (written and verbal), and interpersonal skills.

- Experience working in cross-functional, multi-location teams.

- Excellent analytical and problem-solving skills.

- Ability to be flexible and adapt to any given situation.

- Ability to work under pressure and in high stress situations with a calm demeanor.

- Willingness to work occasional evenings and weekends in support of deployments and resolution of production issues


Competencies/Skill sets for this job

Linux Hadoop Root Cause Analysis Sqoop Sla Rca Security Disaster Recovery

Job Posted By

About Organisation

Talenture Management Consulting