Databricks Architect

At Staffworxs, we don t just connect talent we power transformation. Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives growth and innovation for some of the world s top CPG brands, who continue to retain us as their trusted partner.
If you re ready to make an impact, you re in the right place.

Job Details

Title: Databricks Architect
Location: Detroit, MI (Onsite is a must)
Duration: Contract
Pay Rate: Open, DOE
Client Industry: Automotive
Skills Required: Databricks, PySpark, Apache Spark, SQL/Spark SQL, Delta Lake, DLT, Unity Catalog, CI/CD (Azure DevOps), ADF/Databricks Workflows, Cloud Integration (AWS/Azure/Google Cloud Platform), Data Governance, Security & Architecture Design

Job Description

We are seeking a highly skilled Databricks Architect to lead the design and implementation of scalable, secure, and high-performance data solutions on the Databricks Lakehouse Platform. This role is ideal for a senior data engineering/architecture professional with strong hands-on expertise in Spark, PySpark, big data ecosystems, and modern data governance frameworks.

Key Responsibilities

• Architecture Design: Lead the end-to-end design of scalable solutions on the Databricks Lakehouse Platform, including Delta Lake, DLT pipelines, and Unity Catalog.

• Data Engineering Leadership: Guide teams on best practices for batch and streaming ingestion, Spark optimization (PySpark/Scala), performance tuning, and CI/CD for data pipelines.

• Automotive Domain Expertise: Architect solutions for large-scale telematics, manufacturing systems, and connected vehicle data.

• Cloud Integration: Manage and optimize Databricks deployments on AWS, Azure, or Google Cloud Platform; integrate with services like S3, ADLS, IAM, etc.

• Governance & Security: Implement fine-grained access controls, lineage, auditing, and compliance frameworks using Unity Catalog and Delta Lake.

• Stakeholder Collaboration: Work closely with business leaders, data scientists, analysts, and product teams to translate needs into technical roadmaps.

• Innovation: Act as a subject matter expert, recommending emerging technologies and driving innovation in data and AI.

Core Skills & Qualifications

• 9 15 years of experience in Databricks, Python, Big Data, Apache Spark, SQL, and Spark SQL.

• Strong hands-on experience with PySpark and Apache Spark.

• Experience building Data Governance solutions using Unity Catalog or similar frameworks.

• Expertise in creating orchestration layers using Databricks Workflows or Azure Data Factory (ADF).

• Experience implementing CI/CD for Databricks in Azure DevOps.

• Ability to process near real-time data using Auto Loader and DLT pipelines.

• Strong understanding of security layers in Delta Lake.

• Ability to implement massive parallel processing using Spark SQL and PySpark.

• Proven experience delivering cost-effective and optimized Databricks infrastructure.

Staffworxs is an Equal Opportunity Employer.
We celebrate diversity and are committed to creating an inclusive workplace for all employees, regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or veteran status.