What are the responsibilities and job description for the W2 Position :: Hadoop Admin :: Richardson, TX (Onsite 5 Days a Week) position at EROS Technologies Inc?
Role: Hadoop Admin
Location: Richardson, TX (Onsite 5 Days a Week)
Type: Contract
Looking for a skilled Hadoop Administrator with hands-on development experience, strong Shell scripting, and solid Linux expertise. The role involves managing Hadoop clusters, supporting big data workflows, and automating operational tasks.
Responsibilities
- Install, configure, and maintain Hadoop clusters (HDFS, YARN, MapReduce).
- Manage Hadoop ecosystem tools: Hive, Spark, Kafka, HBase, Sqoop, Oozie, Zookeeper.
- Monitor, troubleshoot, and optimize cluster performance.
- Develop automation scripts using Shell/Python.
- Support data pipelines and Hadoop-based applications.
- Administer Linux servers, perform OS tuning, and handle system issues.
- Manage security, upgrades, patches, and cluster capacity.
Required Skills
- 4–8 years of Hadoop Administration experience.
- Strong Shell scripting and Linux administration skills.
- Experience with Spark, Hive, Kafka, HBase, Sqoop, Oozie, Zookeeper.
- Good understanding of Hadoop architecture and distributed systems.
- Experience with Cloudera/Ambari/Hortonworks.
Nice to Have
- Cloud (AWS EMR / Azure HDInsight / GCP Dataproc)
- Python development
- CI/CD exposure (Jenkins, Git)