What are the responsibilities and job description for the AWS Kafka Engineer / Administrator position at TECHAGI SOLUTIONS LLC?
Key Responsibilities:
Design, deploy, configure, upgrade, and manage highly available Apache Kafka and Confluent Platform clusters.
Monitor and troubleshoot Kafka brokers, replication, partitions, consumer lag, throughput, and performance.
Manage Kafka topics, Schema Registry, Kafka Connect, and integrations with AWS S3, Trino, and OpenSearch.
Implement Kafka security using TLS, SASL, ACLs, RBAC, and credential management.
Automate infrastructure provisioning and platform operations using Terraform, Ansible, Python, and CI/CD pipelines.
Support disaster recovery, cross-cluster replication, failover, and production incident resolution.
Collaborate with engineering teams on Kafka architecture, performance optimization, and operational best practices.
Required Technical Skills:
Apache Kafka / Confluent Platform Administration
AWS / Amazon MSK
Kafka Connect, Schema Registry, Replication & Performance Tuning
Terraform, Ansible, Python / Shell Scripting
Prometheus, Grafana, OpenSearch
Kafka Security – TLS, SASL, ACLs, RBAC
CI/CD, GitOps, Production Support & Troubleshooting
Preferred Skills:
Experience with Kubernetes, OpenShift, Confluent Cloud, KRaft, Cluster Linking, Jenkins, GitLab, GitHub Actions, and Argo CD.
Important: Candidates must be local to Denver, Colorado, or St. Louis, Missouri and available to work onsite. Strong production Kafka administration and troubleshooting experience is essential.
Salary : $60 - $65