What are the responsibilities and job description for the Hadoop Developer - Fulltime position at Pioneer Corporate Services Inc?
Job Title: Hadoop Developer
Skill Digital: Cloudera Hadoop Administrator
Minimum Experience: 6 - 10 Years
Location: Charlotte, NC / Plano, TX (Onsite)
Job Description:
- Kafka configurations, monitoring and deployments
- Experience Spark and Scala/Java
- Experience with Kafka brokers, producers, and consumers.
- Knowledge of Kafka concepts such as topics, partitions, and offsets.
- Experience with HDFS, MapReduce, and Hadoop ecosystems.
- Understanding data storage and data processing techniques in Hadoop
- Performance tuning
- Shell Scripting
- Experience in Cloudera platform (CDP)
Additional requirements
- Agile Process -Jira/confluence
- CI/CD deployments
- Experience in Git/Bitbucket
- Meta Data Driven ETL knowledge/Experience
Banking Domain knowledge