Senior Data Architect

LatentView Analytics is one of the world’s largest and fastest-growing digital analytics firms.

We help companies drive digital transformation by helping them combine digital and traditional data to gain a competitive advantage. LatentView provides a 360-degree view of the digital consumer, enabling companies to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, and optimize investment decisions.

Role: Databricks Architect

Location: Detroit City in Michigan

Authorized to work in the United States

No Need of Visa sponsorship

Key Responsibilities

Architecture Design: Lead the end-to-end design of scalable data solutions on the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables (DLT), and Unity Catalog.

Data Engineering Leadership: Guide teams on best practices for batch/streaming ingestion, Spark optimization (PySpark/Scala), performance tuning, and CI/CD for data pipelines.

Automotive Domain Expertise: Understand and architect solutions for automotive-specific challenges (e.g., large-scale telematics, manufacturing data, connected vehicle data).

Cloud Integration: Manage and optimize Databricks on AWS, Azure, or GCP, integrating with other cloud services (S3, ADLS, IAM, etc.).

Governance & Security: Implement fine-grained access controls, data lineage, and compliance with security standards.

Stakeholder Collaboration: Work with business leaders, data scientists, analysts, and product owners to translate needs into technical roadmaps.

Innovation: Act as a subject matter expert (SME), recommending emerging tech and driving innovation in data & AI.

Core Skills & Qualifications

9-15 years experienced resources in Databricks, Python, Big Data, Apache Spark, SQL and Spark SQLd

Strong hands on in Pyspark and Apache Spark.

Experience in Building Data Governance Solutions like Unity Catalog …etc

Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows.

Build CICD for Databricks in Azure Devops.

Process near Real time Data thru Auto Loader, DLT Pipelines.

Implement Security Layer in Delta Lake.

Implement Massive Parallel Processing Layers in Spark SQL and PySpark.

Implement Cost effective Infrastructure in Databricks.

EEO Statement

“At LatentView Analytics LLC, we value a diverse, inclusive workforce and we provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual’s race, color, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws. If you are unable to submit your application because of incompatible assistive technology or a disability, please contact us at usrec@latentview.com. LatentView Analytics LLC will reasonably accommodate qualified individuals with disabilities to the extent required by applicable law.”