What are the responsibilities and job description for the Kafka, and Hadoop Developer position at Envision Technology Solutions?
Role : Kafka, and Hadoop Developer
Location: Newark DE / Pennington NJ / Charlotte NC / Atlanta GA / Addison TX / Plano TX (Hybrid)
Duration: Fulltime Role
Must Have Technical/Functional Skills
Primary Skill: Kafka, Redis, Hadoop, PySpark
Secondary: Python
Experience: Minimum 10 years
Roles & Responsibilities
· Bachelor's or Master's degree in Science or Engineering, or a related field.
· Minimum of 5 years of industry experience, with at least 3 years focused on hands-on work in Big Data and real-time data processing technologies.
· Proficiency in real-time streaming technologies like Kafka (KStreams, KTable)
· Proficiency in Hadoop and PySpark
· Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase.
· Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting.
· Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications.
· Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures.
· Experience with additional real-time streaming technologies like Flink or Storm.
· Familiarity with Cloud Technologies such as Azure, AWS, or GCP.
· Working knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models.
· Proficiency in Data Integration and Data Security within real-time and Big Data ecosystems, including knowledge of Kerberos.
· Strong command of Visual Analytics Tools, with a focus on Tableau.