What are the responsibilities and job description for the Azure Databricks Platform Administrator position at LTM?
Role Description
Azure Databricks Platform Administrator
Location - Raritan, NJ
Job Summary
We are seeking an experienced Azure Databricks Platform Administrator to design operate secure and optimize enterprisescale Databricks environments on Microsoft Azure The role is responsible for platform governance workspace administration identity and access management networking security monitoring automation cost optimization and production support The ideal candidate combines strong Azure infrastructure knowledge with handson Databricks administration and works effectively with data engineering analytics security cloud and application teams
Key Responsibilities
Administer Azure Databricks accounts workspaces clusters cluster policies pools SQL warehouses jobs notebooks repositories libraries and access controls across development test and production environments
Manage workspace provisioning and configuration using Infrastructure as Code and automated deployment pipelines
Implement identity and access management through Microsoft Entra ID single signon service principals managed identities groups rolebased access control and SCIM provisioning
Administer Unity Catalog including metastores catalogs schemas tables volumes storage credentials external locations privileges and dataaccess governance
Configure secure Azure networking including virtual network injection private endpoints Private Link network security groups route tables DNS firewalls and controlled egress
Integrate Databricks with Azure Data Lake Storage Key Vault Azure DevOps or GitHub monitoring platforms and other approved enterprise services
Establish cluster standards runtime policies library controls tagging autoscaling autotermination and workload isolation
Monitor platform availability performance capacity audit logs job health and security events build dashboards and actionable s
Lead incident problem change release and servicerequest management for the platform meeting agreed service levels and operational KPIs
Troubleshoot complex workspace compute authentication authorization connectivity storage Spark and integration issues
Optimize platform cost through usage analysis rightsizing policy enforcement commitment utilization chargebackshowback and removal of idle resources
Plan and execute Databricks Runtime upgrades platform changes vulnerability remediation businesscontinuity testing and disasterrecovery activities
Define and maintain platform standards runbooks architecture diagrams operating procedures support documentation and knowledge articles
Partner with engineering architecture security compliance FinOps and vendor teams to onboard workloads and drive continuous improvement
Mentor junior administrators and provide technical leadership for platform operations and governance
Required Qualifications And Experience
5 years of experience in cloud dataplatform infrastructure DevOps or productionsupport roles including substantial handson administration of Azure Databricks
Strong understanding of Azure Databricks architecture control plane and data plane concepts workspaces compute jobs SQL warehouses Delta Lake and Unity Catalog
Handson experience with core Azure services such as Microsoft Entra ID Azure Data Lake Storage Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics and Azure DevOps
Strong knowledge of cloud security leastprivilege access secrets management encryption network isolation auditability and enterprise governance
Experience automating Azure and Databricks administration using Terraform Bicep or ARM templates Databricks Asset Bundles Azure CLI Databricks CLI REST APIs PowerShell Python or shell scripting
Experience building and supporting CICD pipelines for infrastructure and platform configuration
Working knowledge of Apache Spark Python SQL Delta Lake and common dataengineering workload patterns
Strong troubleshooting skills across identity networking compute storage security and distributed dataprocessing layers
Experience operating production platforms using ITILaligned incident problem change release capacity and servicelevel management practices
Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent practical experience
Technical Competencies
Databricks Account Console workspace administration compute cluster policies jobs SQL warehouses Unity Catalog Delta Lake audit logs system tables authentication and REST APIs
Azure Entra ID ADLS Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics Azure Policy and Azure DevOps
Automation and DevOps Terraform Bicep or ARM Git CICD Databricks Asset Bundles PowerShell Python shell scripting and com
Other Details
Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits And Perks
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Azure Databricks Platform Administrator
Location - Raritan, NJ
Job Summary
We are seeking an experienced Azure Databricks Platform Administrator to design operate secure and optimize enterprisescale Databricks environments on Microsoft Azure The role is responsible for platform governance workspace administration identity and access management networking security monitoring automation cost optimization and production support The ideal candidate combines strong Azure infrastructure knowledge with handson Databricks administration and works effectively with data engineering analytics security cloud and application teams
Key Responsibilities
Administer Azure Databricks accounts workspaces clusters cluster policies pools SQL warehouses jobs notebooks repositories libraries and access controls across development test and production environments
Manage workspace provisioning and configuration using Infrastructure as Code and automated deployment pipelines
Implement identity and access management through Microsoft Entra ID single signon service principals managed identities groups rolebased access control and SCIM provisioning
Administer Unity Catalog including metastores catalogs schemas tables volumes storage credentials external locations privileges and dataaccess governance
Configure secure Azure networking including virtual network injection private endpoints Private Link network security groups route tables DNS firewalls and controlled egress
Integrate Databricks with Azure Data Lake Storage Key Vault Azure DevOps or GitHub monitoring platforms and other approved enterprise services
Establish cluster standards runtime policies library controls tagging autoscaling autotermination and workload isolation
Monitor platform availability performance capacity audit logs job health and security events build dashboards and actionable s
Lead incident problem change release and servicerequest management for the platform meeting agreed service levels and operational KPIs
Troubleshoot complex workspace compute authentication authorization connectivity storage Spark and integration issues
Optimize platform cost through usage analysis rightsizing policy enforcement commitment utilization chargebackshowback and removal of idle resources
Plan and execute Databricks Runtime upgrades platform changes vulnerability remediation businesscontinuity testing and disasterrecovery activities
Define and maintain platform standards runbooks architecture diagrams operating procedures support documentation and knowledge articles
Partner with engineering architecture security compliance FinOps and vendor teams to onboard workloads and drive continuous improvement
Mentor junior administrators and provide technical leadership for platform operations and governance
Required Qualifications And Experience
5 years of experience in cloud dataplatform infrastructure DevOps or productionsupport roles including substantial handson administration of Azure Databricks
Strong understanding of Azure Databricks architecture control plane and data plane concepts workspaces compute jobs SQL warehouses Delta Lake and Unity Catalog
Handson experience with core Azure services such as Microsoft Entra ID Azure Data Lake Storage Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics and Azure DevOps
Strong knowledge of cloud security leastprivilege access secrets management encryption network isolation auditability and enterprise governance
Experience automating Azure and Databricks administration using Terraform Bicep or ARM templates Databricks Asset Bundles Azure CLI Databricks CLI REST APIs PowerShell Python or shell scripting
Experience building and supporting CICD pipelines for infrastructure and platform configuration
Working knowledge of Apache Spark Python SQL Delta Lake and common dataengineering workload patterns
Strong troubleshooting skills across identity networking compute storage security and distributed dataprocessing layers
Experience operating production platforms using ITILaligned incident problem change release capacity and servicelevel management practices
Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent practical experience
Technical Competencies
Databricks Account Console workspace administration compute cluster policies jobs SQL warehouses Unity Catalog Delta Lake audit logs system tables authentication and REST APIs
Azure Entra ID ADLS Gen2 Key Vault Virtual Network Private Link Azure Monitor Log Analytics Azure Policy and Azure DevOps
Automation and DevOps Terraform Bicep or ARM Git CICD Databricks Asset Bundles PowerShell Python shell scripting and com
Other Details
Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits And Perks
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Salary : $100,000 - $120,000