What are the responsibilities and job description for the DevOps Kubernetes Engineer position at Quantum World Technologies Inc.?
Job Opening : DevOps Kubernetes Engineer
Location : Plano, TX (Onsite)
Full Time
Job descriptio
- nDesign, build, and operate large-scale data platforms powered by Apache Airflo
- wManage and optimize hundreds to thousands of DAGs with high task throughpu
- tDrive platform reliability, scalability, and performance improvement
- sOwn end-to-end lifecycle: deployment, monitoring, incident response, and roadmap executio
- nCollaborate with cross-functional teams to enable robust, secure, and efficient data workflow
- sStrong hands-on experience with DAG design, testing & idempotenc
- yDeep knowledge of sensors, deferrable operators, dynamic task mapping, SLAs, retries, backfill
- sExperience with cross-DAG dependencies, task groups, datasets, pools, and queue
- sExperience running Airflow on Kubernetes (Helm, autoscaling, tuning
- )Understanding of network policies, PDBs, and deployment strategies (blue-green / canary
- )Automation-first mindset with Terraform, Helm, GitOps (Argo CD / Flux), CI/C
- DStrong Python skills for DAGs, operators, and utilitie
- sFamiliarity with Bash; exposure to Go or Java is a plu
- sHands-on with Prometheus, Grafana, StatsD, and logging system
- sExperience with capacity planning, performance tuning, and reliability practice
- sExperience with Azure (preferred) or any major clou
- dExposure to Snowflake, BigQuery, Redshift, Databricks, Spark, EMR/Datapro
- cSolid understanding of IAM, VPC networking, and storage (S3/GCS/ADLS
- )Knowledge of SSO/OIDC, RBAC, secrets management (Vault/Secrets Manager
- )Strong focus on auditing, least privilege, and governanc