What are the responsibilities and job description for the Kafka Developer position at Pi-Square Technologies?
Kafka Developer
Role Overview: We are seeking a highly skilled Kafka Engineer to design, build, and optimize real-time data streaming solutions within the financial services domain. The ideal candidate will have strong expertise in Apache Kafka, distributed systems, and event-driven architectures, with a focus on secure, scalable, and high-performance data pipelines supporting mission-critical financial applications.
Key Responsibilities:
Required Skills & Experience:
Role Overview: We are seeking a highly skilled Kafka Engineer to design, build, and optimize real-time data streaming solutions within the financial services domain. The ideal candidate will have strong expertise in Apache Kafka, distributed systems, and event-driven architectures, with a focus on secure, scalable, and high-performance data pipelines supporting mission-critical financial applications.
Key Responsibilities:
- Design, develop, and maintain Kafka-based streaming platforms for financial transaction processing, fraud detection, and risk management.
- Implement data ingestion pipelines from multiple sources (trading systems, payment gateways, customer data platforms).
- Ensure high availability, scalability, and fault tolerance of Kafka clusters in production environments.
- Collaborate with business analysts, data engineers, and application developers to integrate Kafka with financial applications and legacy systems.
- Monitor, troubleshoot, and optimize Kafka performance, ensuring compliance with financial industry standards and regulations.
- Develop automation scripts for deployment, monitoring, and alerting using tools like Kubernetes, Docker, and CI/CD pipelines.
- Implement security best practices including encryption, authentication, and role-based access control for sensitive financial data.
- Provide technical leadership and mentoring to junior engineers on Kafka and event-driven architecture.
Required Skills & Experience:
- 5 years of experience in Kafka engineering, with at least 2 years in the financial domain.
- Strong knowledge of Apache Kafka, Kafka Streams, Kafka Connect, and Schema Registry.
- Experience with distributed systems, microservices, and event-driven architectures.
- Proficiency in Java, Scala, or Python for building Kafka producers/consumers.
- Hands-on experience with cloud platforms (Azure, AWS, or Google Cloud Platform) and containerization (Docker, Kubernetes).
- Familiarity with financial systems such as payment processing, trading platforms, or risk management solutions.
- Strong understanding of data security, compliance, and regulatory requirements in financial services.
Salary : $50 - $60