What are the responsibilities and job description for the Apache Druid + Trino + DevOps + Python Demand - Sunnyvale, CA (Onsite) position at ProCorp Systems Inc.?
Apache Druid Trino DevOps Python Demand
Sunnyvale, CA (Onsite)
Skill Sets Required:
Core Technical Skills
- Apache Druid
- Cluster setup, configuration, and production operations
- Real-time and batch ingestion (Kafka, streaming tasks, indexing services)
- Segment management, compaction, retention, and query optimization
- Troubleshooting performance and availability issues
- Trino
- Cluster deployment and tuning for large-scale distributed queries
- Connector configuration (Hive, Iceberg, Delta Lake, JDBC, etc.)
- Query optimization, memory management, and workload isolation
- Security configuration (authentication, authorization, access control)
- Python
- Strong proficiency in Python for automation and backend services
- Writing clean, maintainable, production-grade code
- Building tooling for deployment, monitoring, and operational workflows
- Experience with REST APIs, scripting, and data processing libraries
DevOps & Platform Engineering
- Containerization & Orchestration
- Docker image creation and optimization
- Kubernetes deployment, scaling, and troubleshooting
- Helm charts and Kubernetes operators (preferred)
- Infrastructure & CI/CD
- Infrastructure as Code using Terraform, CloudFormation, or similar
- CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins, ArgoCD, etc.)
- Blue-green and rolling deployment strategies
- Cloud Platforms
- Hands-on experience with AWS, Google Cloud Platform, or Azure
- Networking, storage, and compute optimization for data workloads
- Cost monitoring and optimization
Observability & Operations
- Monitoring and alerting using Prometheus, Grafana, ELK, OpenTelemetry, or similar
- Log aggregation, metrics, and distributed tracing
- Incident management, root cause analysis, and postmortems
- Capacity planning and performance benchmarking