What are the responsibilities and job description for the Databricks Administrator ( Need locals to Texas who can do Face 2 Face interview at Austin, Texas) position at Innovee Consulting LLC?
Job Title: Databricks Administrator
Duration: 4 Months
Location: Austin, TX
Need locals to Texas who can do Face 2 Face interview at Austin, Texas
Job Summary:
Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives. Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports. Writes detailed description of user needs, program functions, and steps required to develop or modify computer program. Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.
Key responsibilities:
- Administer configure and support the Databricks platform
- Enable scalable data engineering analytics and AI ML workloads
- Ensure platform reliability security cost optimization and compliance
- Support data engineers analysts and data scientists
- Manage workspace configuration and cluster policies
- Handle user access control and permissions
- Integrate Databricks with cloud services
- Monitor platform performance and usage
- Support enterprise data and analytics initiatives
Required Skills (8 Years Each):
- Administering Databricks workspaces in AWS cloud environment
- Databricks cluster configuration job scheduling and workspace management
- User access roles and permissions using IAM SCIM and RBAC
- Apache Spark concepts performance tuning and troubleshooting
- Integration with cloud storage services like S3
- Cluster policies implementation and workspace governance
- Databricks SQL notebooks and job orchestration
- Platform monitoring health performance and availability
- Data security encryption and compliance requirements
- DevOps automation tools Terraform CI CD and scripting
Preferred Skills (4 Years Each):
- Databricks administration in enterprise or government environments
- Databricks Unity Catalog for governance and access control
- Cost management and optimization for Databricks workloads
- AI ML workloads support using Databricks ML and MLflow
- Data lake and lakehouse architecture knowledge
- Programming skills in Python SQL or Scala