Azure Databricks Administrator -W2 only

Job Title: Azure Databricks Administrator (W2 Only)
Location: Rocky Hill, CT - Onsite
# of Positions: 2

Job Overview:
We are looking for a skilled Azure Databricks Administrator to support and manage enterprise-scale data analytics platforms. This role requires strong hands-on experience with Azure cloud services and Azure Databricks, focusing on platform administration, performance optimization, security, and operational stability. The ideal candidate will work closely with data engineering, analytics, and DevOps teams to ensure a reliable and scalable data environment.

Key Responsibilities:

• Administer and support Azure Databricks workspaces, clusters, pools, jobs, and notebooks.

• Configure, monitor, and optimize Databricks cluster and pool performance, availability, and cost.

• Implement and manage Databricks Unity Catalog for centralized data governance, access control, and lineage tracking.

• Utilize Databricks Assistant to improve operational efficiency, troubleshoot issues, and support user productivity.

• Manage Azure infrastructure supporting Databricks including ADLS Gen2, Azure VMs, VNETs, NSGs, Key Vault, and Azure AD.

• Implement and maintain security best practices including RBAC, workspace access controls, secrets management, and data permissions.

• Monitor platform health using Azure Monitor, Log Analytics, and Databricks metrics.

• Troubleshoot Databricks, Spark, and Azure-related issues across environments.

• Support CI/CD pipelines for Databricks using Azure DevOps or GitHub.

• Collaborate with data engineers and architects on platform improvements and scaling.

• Maintain documentation, operational procedures, and support runbooks.

• Participate in production support and incident resolution as needed.

Required Qualifications:

• Hands-on experience in Azure cloud administration.

• Hands-on experience administering Azure Databricks, including cluster and pool setup/management.

• Working knowledge of Databricks Unity Catalog and Databricks Assistant.

• Strong understanding of Apache Spark architecture and Databricks job orchestration.

• Experience with Azure storage services (ADLS Gen2, Blob Storage).

• Knowledge of Azure networking and security concepts.

• Experience with Infrastructure as Code (Terraform, ARM templates).

• Proficiency with Linux environments.

• Strong problem-solving and communication skills.

Preferred Qualifications:

• Azure certifications (AZ-104, AZ-305) or Databricks certification.

• Experience supporting enterprise or large-scale data platforms.

• Scripting experience with Python, PowerShell, or Bash.

• Familiarity with governance, compliance, and data security standards.
  
  Infowave Systems is an equal opportunity employer that is committed to diversity and inclusion in the workplace.