What are the responsibilities and job description for the Confluent Kafka Lead & Python Developer position at ImagineX Consulting?
ImagineX is a tech company that deploys AI-assisted teams to build and secure mission-critical enterprise solutions with our clients – spanning software, data, and AI. Structured like a software company, not a traditional consultancy, we blend deep technical expertise with authentic values, achieving world-class satisfaction (NPS 91). Our dedicated teams specialize in software, data, and AI across the U.S. and LATAM, bridging the gap between boutique agility and enterprise scale.
Executive Summary
We are seeking a high-caliber Senior Developer to serve as the Confluent Kafka Lead for our enterprise middleware initiatives. This critical role requires a specialized blend of deep expertise in the Confluent Kafka platform and robust Python development skills. You will be responsible for leading new Kafka work, architecting data streaming workflows, and building the essential microservices and connectors required to support a scalable, high-performance data ecosystem.This is a full-time role that requires in office collaboration 3 days per week located Downtown Columbus.
Key Responsibilities
- Data Streaming Leadership: Direct the design and implementation of new Kafka-based initiatives, ensuring best practices for data streaming and event-driven architecture.
- Microservices Development: Build and maintain scalable backend microservices using Python to support real-time data processing and system integration.
- Kafka Ecosystem Management: Develop and configure custom Kafka Connectors and leverage Kafka Streams for complex data transformations and real-time analytics.
- Workflow Optimization: Design and implement end-to-end data pipelines that ensure high availability, data integrity, and low latency across enterprise systems.
- Technical Mentorship: Provide guidance to cross-functional teams on Kafka architecture, schema registry management, and Python development standards.
Required Technical Skills
- Messaging Platforms: Extensive experience with Confluent Kafka, including Kafka Connect, Kafka Streams, KSQL, and Schema Registry.
- Programming: Senior-level proficiency in Python for building backend services, automation scripts, and data processing engines.
- Cloud & Infrastructure: Hands-on experience with major cloud platforms (AWS, Azure, or GCP) and containerization tools like Docker and Kubernetes.
- Data Integration: Proven ability to build and deploy custom connectors and integrate diverse data sources (e.g., SQL/NoSQL databases, Mainframe systems) into Kafka clusters.
- DevOps: Familiarity with CI/CD pipelines (Jenkins, GitLab, or ArgoCD) and Infrastructure-as-Code (Terraform) is highly preferred.
Professional Qualifications
- 7 years of experience in software development with at least 2 years in a technical lead or senior architectural capacity.
- Strong background in Agile/Scrum methodologies and experience working in fast-paced, deadline-oriented environments.
- Exceptional analytical and problem-solving skills, with a focus on building resilient and fault-tolerant systems.