Lead Solution Cloud Architect Azure Databricks

Job Title: Lead Solution Cloud Architect – Azure Databricks

Location: Minneapolis, MN – Hybrid
Salary: $150K–$160K
Experience: 12–15 Years
Industry: Enterprise Cloud / Data

Job Description

We are seeking an accomplished Lead Solution Cloud Architect with 12–15 years of experience designing, implementing, and governing enterprise cloud and data architectures. The ideal candidate will bring deep expertise in Microsoft Azure and Databricks, combined with strong solution architecture, technical leadership, and stakeholder management skills.

Key Responsibilities

• Architect enterprise-grade cloud and data solutions using Microsoft Azure services including Azure VMs, Blob Storage, Data Factory, Functions, Event Hubs, Azure AD, and Synapse Analytics.
• Design scalable Databricks Lakehouse architectures leveraging Spark, Delta Lake, Unity Catalog, MLflow, governance, and MLOps.
• Architect scalable ETL/ELT pipelines, real-time streaming solutions, and reusable data integration frameworks.
• Develop HLDs, LLDs, architecture blueprints, data-flow diagrams, integration patterns, security architectures, and deployment models.
• Design hybrid cloud/on-premises data platforms using ADLS, ADF, Azure Databricks, Synapse, Purview, and Azure DevOps.
• Lead requirements discovery and translate business objectives into technical architectures and modernization roadmaps.
• Provide hands-on technical direction to data engineering, analytics, DevOps, and platform teams.
• Establish standards for data governance, CI/CD, infrastructure automation, security, and environment management.
• Evaluate existing architectures and recommend improvements for scalability, resiliency, performance, security, and cost optimization.
• Serve as the technical SME for client workshops, architecture discussions, and executive presentations.
• Partner with business and technology stakeholders to define solution vision, roadmap, and success metrics.

Required Skills

• 12–15 years of overall IT experience in cloud, data engineering, and enterprise architecture.
• 5 years of Microsoft Azure architecture experience.
• 5 years of Databricks experience with Spark, Delta Lake, Unity Catalog, and MLflow.
• Strong hands-on experience with Python, SQL, PySpark, and distributed data processing.
• Strong knowledge of data modeling, data governance, metadata management, and security.
• Experience with CI/CD, Terraform, Azure Bicep/ARM Templates, GitOps, and automation.
• Strong Azure networking knowledge including VNets, NSGs, Private Endpoints, Azure AD/Entra ID, RBAC, encryption, and identity governance.
• Understanding of enterprise security frameworks such as NIST and CIS.
• Excellent architecture, communication, presentation, and stakeholder-management skills.

Preferred Skills

• Azure Solutions Architect certification.
• Databricks certifications.
• Experience with Azure Purview/Microsoft Purview.
• Experience designing MLOps and AI/ML data platforms.
• Experience with real-time streaming and Event Hubs.
• Strong experience leading enterprise cloud modernization programs.