What are the responsibilities and job description for the Databricks Administrator position at Smart IT Frame LLC?
Role: Databricks Administrator
Location: Raritan, NJ (Onsite)
We are looking for an experienced Azure Databricks Platform Administrator (5–7 years) to manage, secure, monitor, and optimize enterprise Azure Databricks environments.
Key Responsibilities:
• Administer Databricks workspaces, clusters, jobs, and platform configurations
• Manage Unity Catalog, governance, security controls, and access management
• Integrate Azure Databricks with ADLS Gen2, Key Vault, Entra ID, Azure Monitor, and networking services
• Drive cluster optimization, performance tuning, monitoring, and cost management
• Support CI/CD and automation using Terraform, Azure DevOps, Databricks CLI, and REST APIs
• Collaborate with engineering, architecture, and security teams to ensure platform reliability and compliance
Required Skills:
Azure Databricks Administration
Azure Functions
Unity Catalog & Delta Lake
ADLS Gen2, Key Vault, Entra ID
Terraform, Azure DevOps, Python/Bash/PowerShell
Platform Monitoring, Security & Governance