What are the responsibilities and job description for the Hadoop Administrator position at Quantum World Technologies Inc.?
Title: Hadoop Administrator
Location: Irving, Tx / Tampa, FL (Hybrid - 3days)
- Need candidate with 8 yrs of experience, deploying maintaining the Hadoop cluster adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager configuring the Name Node high availability
- Keeping a track of all the running Hadoop jobs
- Implementing managing and administering the overall Hadoop infrastructure
- Takes care of the day today running of Hadoop clusters
- Work closely with the database team network team BI team and application teams to make sure that all the big data applications are highly available and performing as expected
- Knowledge on Apache Distribution have to manually setup all the configurations CoreSite HDFS Site, YARN Site and Map Red Site
- Aware of the configuration setup using Hadoop distribution like Hortonworks Cloudera or MapR
- Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster deciding the size of the Hadoop cluster based on the data to be stored in HDFS
- Ensure that the Hadoop cluster is up and running all the time Monitoring the cluster connectivity and performance
- Manage and review Hadoop log files Backup and recovery tasks Resource and security management.
- Troubleshooting application errors