What are the responsibilities and job description for the Databricks Administrator position at IT FACE Inc.?
Job Title: Databricks Administrator
Location: Dallas, TX (Onsite/Hybrid as applicable)
Job Description:
We are seeking an experienced Databricks Administrator to manage, support, and optimize enterprise Databricks environments. The ideal candidate will have extensive experience in data platforms, cloud technologies, system administration, and platform operations. This role requires strong technical expertise in Databricks, Apache Spark, cloud infrastructure, security, and performance optimization.
Key Responsibilities:
- Administer and support Databricks environments across Development, Test, and Production.
- Manage workspace configurations, cluster policies, job scheduling, and platform settings.
- Monitor platform performance, utilization, and cost optimization initiatives.
- Configure and maintain user access, permissions, roles, and security controls.
- Integrate Databricks with cloud platforms including Azure, AWS, or Google Cloud Platform.
- Support deployment and management of notebooks, jobs, workflows, and automation processes.
- Troubleshoot platform, connectivity, security, and performance-related issues.
- Ensure platform reliability through backup, recovery, and high-availability strategies.
- Collaborate with data engineers, architects, analysts, and business teams.
- Implement governance, compliance, and enterprise security best practices.
- Maintain technical documentation, operational procedures, and support processes.
- Support platform upgrades, patches, and adoption of new features.
Required Skills & Qualifications:
- Bachelor''''s degree in Computer Science, Information Technology, or a related field.
- 10 years of overall IT experience with strong exposure to data platforms and cloud environments.
- Hands-on experience administering Databricks environments.
- Strong knowledge of Apache Spark, cluster management, and distributed computing.
- Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform.
- Strong understanding of Identity and Access Management (IAM), networking, and security best practices.
- Experience with system monitoring, troubleshooting, and performance tuning.
- Proficiency in SQL, Python, and scripting for automation.
- Excellent analytical, communication, and problem-solving skills.
Preferred Skills:
- Experience with CI/CD pipelines and DevOps practices.
- Knowledge of Delta Lake, Unity Catalog, and data governance frameworks.
- Experience working in enterprise data warehouse or big data environments.
- Databricks and/or cloud platform certifications.
- Experience with infrastructure automation and cloud-native services.