What are the responsibilities and job description for the DevOps Engineer with Palantir Foundry, Databricks (W2 Requirement) position at 3BEES TECHNOLOGIES INC?
Role: DevOps Engineer with Palantir Foundry, Databricks (W2 Requirement)
Location: Plano, TX (Onsite)
Duration: Long term
Position Overview: We are seeking a DevOps/Platform Engineer to build, maintain, and optimize cloud infrastructure and CI/CD pipelines supporting modern data platforms including Palantir Foundry, Databricks, and Snowflake. The ideal candidate will have deep expertise in Azure, strong automation skills, and experience with containerization and orchestration technologies.
Key Responsibilities:
- Design and implement cloud infrastructure on Azure using Infrastructure as Code
- Build and maintain CI/CD pipelines for data platforms, applications, and microservices using Jenkins, GitHub
- Manage container orchestration using Kubernetes (AKS) including deployments, scaling, and service mesh configurations
- Automate infrastructure provisioning, configuration management, and deployment processes
- Maintain and version infrastructure configuration files (YAML, JSON, HCL/Terraform) across environments
- Implement monitoring, logging, and alerting solutions
- Support Databricks workspace administration, cluster optimization, and cost management
- Manage Snowflake environments, virtual warehouses, and resource monitors
- Ensure security, compliance, and governance across cloud infrastructure
- Implement disaster recovery, backup, and high-availability strategies
- Support GenAI and ML infrastructure (GPU-enabled clusters, model serving endpoints, LLM deployment pipelines)
- Collaborate with engineering teams to improve deployment velocity and reliability
Required Qualifications:
- 3 years of DevOps/Platform engineering experience
- Expert-level proficiency with Azure cloud platform
- Strong experience with Docker in production environments
- Hands-on experience with Infrastructure as Code tools (Terraform, CloudFormation, Ansible)
- Proficiency in CI/CD pipeline design and implementation (Jenkins, GitHub Actions, GitLab CI)
- Scripting skills in Python, Bash, or PowerShell
- Experience with monitoring and observability tools
- Understanding of networking, security, and compliance requirements
Preferred Qualifications:
- Experience operating Databricks, Snowflake, or Palantir Foundry environments
- Knowledge of MLOps practices and model deployment pipelines