What are the responsibilities and job description for the Kafka Admin position at Capgemini?
Role: Kafka Admin
Location: NYC, NY
Fulltime Permanent
Job Description:
Kafka Administrator is responsible for the installation, configuration, management, and monitoring of Apache Kafka clusters, ensuring high availability, security, and optimal performance. They manage the Kafka environment, including brokers, topics, and partitions, and work with other teams to integrate Kafka with various systems.
• Kafka Cluster Management: Installing, configuring, and maintaining Kafka clusters, including high availability and disaster recovery strategies.
• Performance Optimization :Monitoring performance, identifying bottlenecks, and fine-tuning Kafka for optimal throughput and latency.
• Security Management: Implementing and managing security configurations, including access control, authentication, and encryption.
• Monitoring and Alerting: Setting up and maintaining monitoring and alerting systems to proactively identify and address issues.
• Troubleshooting: Diagnosing and resolving issues within the Kafka ecosystem, including performance problems, connectivity issues, and data-related problems.
• Integration: Collaborating with development and other teams to integrate Kafka with other systems and applications, including data ingestion and real-time data streaming.
• Documentation: Creating and maintaining documentation for Kafka configurations, processes, and procedures.
• Automation: Automating routine tasks and developing scripts to streamline cluster management.
• Q2: Assessing current and future resource needs to ensure the Kafka environment can scale effectively.