What are the responsibilities and job description for the Azure Databricks Admin position at eHub Global Inc?
Azure Databricks Admin
Location : Candidate must be located within commuting distance of Plano TX/Hartford CT/Indianapolis IN/Raleigh NC or be willing to relocate to the area.
Fulltime
Azure Databricks Admin experienced in Cloud Platform Databricks SME, responsible for overseeing the Platform administration, Security, new NPI tools integration, migrations, platform maintenance and other platform administration activities on Azure/AWS. The ideal candidate will have hands-on experience with Azure/AWS services – Infrastructure as Code (IaC), platform provisioning & administration, cloud network design, cloud security principles and automation.
Databricks admin will plays a pivotal role in admin, security best practices, platform sustain support, new tools adoption, cost optimization, supporting new patterns/design solutions using the Databricks platform
Preferred Qualifications:
- Experience of architecture and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools. Able to design scalable data ingestion and transformation workflows, including batch and streaming (e.g., Kafka, Spark Structured Streaming).
- Experience of creating integration guidelines to configure and integrate Databricks with other existing security tools relevant to data access control. Can implement data security and governance using Unity Catalog, access controls, and data classification techniques.
- Experience of supporting migration of legacy systems to Databricks on cloud platforms like Azure, AWS, or GCP. Can manage cloud platform operations with a focus on FinOps support, optimizing resource utilization, cost visibility, and governance across multi-cloud environments.
- Expertise in Databricks platform, security features, Unity Catalog, and data access control mechanisms.
- Experience with data classification and masking techniques. Strong understanding of cloud cost management, with hands-on experience in usage analytics, budgeting, and cost optimization strategies across multi-cloud platforms.