What are the responsibilities and job description for the Databricks DevOps Administrator position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, MASH Pro Tech, is seeking the following. Apply via Dice today!
Title: Databricks DevOps Administrator (MUST be strong on Databricks)
Location: Alpharetta, GA (ONSITE)
Duration: 12 months contract
Note: Strong proficiency in Python, Terraform, and Azure/AWS required.
Position Overview
We are seeking a seasoned Databricks Platform Administrator to design, implement, and manage our enterprise-scale Databricks environment. This role is pivotal in ensuring the platform is secure, scalable, highly available, and optimized for performance and cost. You will work closely with data engineers, data scientists, and cloud architects to administer, automate, and govern the Databricks platform across development, QA, and production environments.
Key Responsibilities
Administer and manage the Databricks environment, including workspace configuration, user management, cluster policies, and job scheduling.
Develop and maintain Infrastructure as Code (IaC) using Terraform to automate the deployment and management of Databricks workspaces and associated cloud resources.
Implement and enforce security best practices, including RBAC, data encryption, network isolation, and audit logging via Unity Catalog.
Monitor platform health, performance, and usage, and implement observability solutions using Databricks-native tools, Prometheus, and Grafana.
Optimize and tune clusters, queries, and workflows for improved performance and cost-efficiency.
Establish and manage CI/CD pipelines for Databricks asset deployment using GitHub Actions or similar tools.
Collaborate with data teams to define and implement governance, compliance, and data management policies.
Provide operational support, troubleshooting, and incident resolution for the Databricks platform.
Required Qualifications
5 years of experience in data platform administration, with a focus on Databricks.
Hands-on experience administering Databricks (workspaces, clusters, Unity Catalog, SQL Warehouses, Delta Lake).
Proficiency in Terraform for infrastructure automation and management.
Strong scripting skills in Python or Java for automation and tooling.
Experience with cloud infrastructure (Azure or AWS) in areas such as IAM, networking, storage, and monitoring.
Knowledge of CI/CD processes and tools like GitHub Actions, GitLab CI, or Jenkins.
Familiarity with monitoring and logging tools such as Prometheus, Grafana, or Datadog.
Preferred Qualifications
Excellent communication skills and experience working in cross-functional teams.
Databricks Certification (e.g., Databricks Certified Associate Administrator).
Experience in regulated industries such as finance or healthcare.
Knowledge of Databricks REST APIs and SDKs for extensibility and automation.
Azure or AWS certifications.
Title: Databricks DevOps Administrator (MUST be strong on Databricks)
Location: Alpharetta, GA (ONSITE)
Duration: 12 months contract
- NOTE: Must be willing to go onsite from day one in Alpharetta, GA
Note: Strong proficiency in Python, Terraform, and Azure/AWS required.
Position Overview
We are seeking a seasoned Databricks Platform Administrator to design, implement, and manage our enterprise-scale Databricks environment. This role is pivotal in ensuring the platform is secure, scalable, highly available, and optimized for performance and cost. You will work closely with data engineers, data scientists, and cloud architects to administer, automate, and govern the Databricks platform across development, QA, and production environments.
Key Responsibilities
Administer and manage the Databricks environment, including workspace configuration, user management, cluster policies, and job scheduling.
Develop and maintain Infrastructure as Code (IaC) using Terraform to automate the deployment and management of Databricks workspaces and associated cloud resources.
Implement and enforce security best practices, including RBAC, data encryption, network isolation, and audit logging via Unity Catalog.
Monitor platform health, performance, and usage, and implement observability solutions using Databricks-native tools, Prometheus, and Grafana.
Optimize and tune clusters, queries, and workflows for improved performance and cost-efficiency.
Establish and manage CI/CD pipelines for Databricks asset deployment using GitHub Actions or similar tools.
Collaborate with data teams to define and implement governance, compliance, and data management policies.
Provide operational support, troubleshooting, and incident resolution for the Databricks platform.
Required Qualifications
5 years of experience in data platform administration, with a focus on Databricks.
Hands-on experience administering Databricks (workspaces, clusters, Unity Catalog, SQL Warehouses, Delta Lake).
Proficiency in Terraform for infrastructure automation and management.
Strong scripting skills in Python or Java for automation and tooling.
Experience with cloud infrastructure (Azure or AWS) in areas such as IAM, networking, storage, and monitoring.
Knowledge of CI/CD processes and tools like GitHub Actions, GitLab CI, or Jenkins.
Familiarity with monitoring and logging tools such as Prometheus, Grafana, or Datadog.
Preferred Qualifications
Excellent communication skills and experience working in cross-functional teams.
Databricks Certification (e.g., Databricks Certified Associate Administrator).
Experience in regulated industries such as finance or healthcare.
Knowledge of Databricks REST APIs and SDKs for extensibility and automation.
Azure or AWS certifications.