What are the responsibilities and job description for the Hadoop Developer position at K&K Global Talent Solutions INC.?
K&K Global Talent Solutions Inc. is an international recruiting agency that has been providing technical resources in the Canada and the USA region since 1993.
This position is with one of our clients in USA, who is actively hiring candidates to expand their teams.
Job Title: Hadoop Developer
Location: Jersey City, NJ /onsite
Position Type: Full time/Permanent role
Job Description
Must Have Technical/Functional Skills
Primary Skill: Hadoop
Secondary: Kafka
Experience: Minimum 10 years
• Kafka configurations, monitoring and deployments
• Experience Spark and Scala/Java
• Experience with Kafka brokers, producers, and consumers.
• Knowledge of Kafka concepts such as topics, partitions, and offsets.
• Experience with HDFS, MapReduce, and Hadoop ecosystems.
• Understanding data storage and data processing techniques in Hadoop
• Performance tuning
• Shell Scripting
• Experience in Cloudera platform (CDP)
Additional requirements
• Agile Process -Jira/confluence
• CI/CD deployments
• Experience in Git/Bitbucket
• Meta Data Driven ETL knowledge/Experience
• Banking Domain knowledge