What are the responsibilities and job description for the Senior Systems Analyst- Databricks Administrator (AWS) position at Technology Recruiting Solutions,Inc.?
Senior Systems Analyst Databricks Administrator (AWS)
(Austin, TX Hybrid Local Candidates Only)
We are seeking an experienced Systems Analyst with a strong background in Databricks administration and cloud-based data platforms. This role will be responsible for managing and optimizing the Databricks environment to support scalable data engineering, analytics, and AI/ML workloads.
This is a highly technical, hands-on role focused on platform reliability, security, governance, and performance.
Key Responsibilities:
- Administer and support Databricks workspaces in a cloud environment (AWS)
- Configure and manage clusters, job scheduling, and workspace settings
- Manage user access, roles, and permissions using IAM, SCIM, and RBAC
- Monitor platform performance, availability, and overall system health
- Implement and enforce cluster policies and governance standards
- Integrate Databricks with cloud storage solutions (e.g., S3)
- Support data engineers, analysts, and data scientists across the platform
- Troubleshoot performance issues and optimize Spark workloads
- Collaborate with DevOps teams to support automation and CI/CD pipelines
Required Qualifications:
- 8 years of experience administering Databricks workspaces in a cloud environment (AWS)
- 8 years of experience with Databricks cluster configuration, job scheduling, and workspace management
- 8 years of experience managing user access, roles, and permissions (IAM, SCIM, RBAC)
- 8 years of experience with Apache Spark concepts, including performance tuning and troubleshooting
- 8 years of experience integrating Databricks with cloud storage services (e.g., S3)
- 8 years of experience implementing cluster policies and governance standards
- 8 years of experience with Databricks SQL, notebooks, and job orchestration
- 8 years of experience monitoring platform performance, health, and availability
- 8 years of understanding data security, encryption, and compliance requirements
- 8 years of experience with DevOps or automation tools (e.g., Terraform, CI/CD, scripting)
Preferred Qualifications:
- 4 years of experience administering Databricks in an enterprise environment
- 4 years of experience with Unity Catalog for governance and access control
- 4 years of experience with cost management and optimization for Databricks workloads
- 4 years of experience supporting AI/ML workloads using Databricks ML and MLflow
- 4 years of familiarity with data lake and lakehouse architectures
- 4 years of experience with Python, SQL, or Scala for administration and troubleshooting
Additional Details:
- Location: Austin, TX (Hybrid work environment)
- Schedule: Monday Friday, standard business hours
- Engagement expected through August 2026, with potential for extension
Requirements:
- Must be authorized to work in the U.S. without sponsorship
- W2 employment only (no C2C or third-party arrangements)
- Candidates must be local to the Austin, TX area
- Ability to work onsite as required in a hybrid environment
Why This Role:
- Opportunity to manage and optimize a modern data platform
- Work with Databricks, AWS, and advanced data/AI workloads
- High-impact role supporting enterprise analytics initiatives