What are the responsibilities and job description for the Azure Databricks Platform Architect / Solution Architect - No C2C position at Purplejack Technologies LLC?
- Architecture & Strategy
- Define end-to-end migration strategy from Azure Databricks to AWS Databricks.
- Design scalable Lakehouse architecture using Medallion principles (Bronze, Silver, Gold).
- Develop Day 1 Business Continuity and Day 2 Modernization / AI Enablement migration roadmaps.
- Perform application and dependency assessments across upstream and downstream systems.
- Establish architecture patterns, standards, and best practices for cloud-native data platforms.
- Migration & Modernization
- Lead migration of data pipelines, notebooks, Delta tables, workflows, and data products.
- Modernize legacy ETL/ELT frameworks using Databricks native capabilities.
- Optimize performance, scalability, security, and operational efficiency.
- Define migration approaches for CDC, batch, streaming, and real-time workloads.
- Drive technology rationalization and tool consolidation initiatives.
- AI-Ready Data Platform
- Build AI-ready data foundations leveraging Delta Lake and Unity Catalog.
- Design data architectures supporting ML, GenAI, RAG, feature stores, and advanced analytics.
- Enable governed data access for data scientists and AI applications.
- Define semantic models, metadata strategies, lineage, and data discovery frameworks.
- Establish frameworks for AI governance and responsible AI adoption.
- Data Governance & Security
- Architect enterprise-wide governance using Unity Catalog.
- Design data lineage, auditing, access controls, masking, and compliance standards.
Requirements
- 15 Years of experience
- Azure Databricks
- AWS Databricks
- Lakehouse architecture
- Medallion principles (Bronze, Silver, Gold)
- Delta Lake
- Unity Catalog
- ML
- GenAI
- RAG
- feature stores
- advanced analytics
- Data Governance
- Data lineage
- auditing
- access controls
- masking
- compliance standards
- ETL/ELT frameworks
Salary : $60