What are the responsibilities and job description for the Databricks Certified Architect position at Quebec solutions inc?
Hiring: Databricks Certified Architect
Location: Washington, DC (Onsite)
Experience: 12 Years
Key Responsibilities
✅ Design and implement enterprise-scale solutions on the **Databricks Lakehouse Platform**.
✅ Architect end-to-end batch and real-time data pipelines using **Apache Spark, PySpark, and Structured Streaming**.
✅ Develop scalable frameworks for data ingestion, transformation, validation, and quality management.
✅ Design and implement **Medallion Architecture (Bronze, Silver, Gold)** utilizing **Delta Lake** and **Delta Live Tables**.
✅ Build and optimize enterprise data warehouses, data marts, and advanced analytics platforms.
✅ Implement data governance, security, lineage, and access controls using **Unity Catalog**.
✅ Develop and support AI/BI dashboards, semantic models, and self-service analytics solutions.
✅ Configure and optimize **Databricks Genie Spaces** to enable conversational analytics and natural language business queries.
✅ Design and deploy **Generative AI** and **RAG (Retrieval-Augmented Generation)** solutions using **Databricks Mosaic AI** and **Vector Search**.
✅ Lead migration initiatives from legacy data warehouses and analytics platforms to Databricks.
✅ Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency.
✅ Define architecture standards, best practices, and reusable design patterns across the organization.
✅ Mentor data engineers, analysts, and architects on Databricks technologies and platform adoption.
Technical Skills
✔ Databricks Lakehouse Platform
✔ Apache Spark, PySpark, Spark SQL
✔ Python and SQL
✔ Delta Lake, Delta Live Tables (DLT), Lakeflow
✔ Unity Catalog
✔ Databricks AI/BI and Genie
✔ Mosaic AI, Vector Search, RAG Architecture
✔ Data Modeling (Dimensional Modeling & Data Vault)
✔ Structured Streaming
✔ Data Quality, Data Governance, and Data Lineage
✔ Microsoft Azure
✔ Terraform, Git, Azure DevOps, Jenkins
✔ REST APIs and Enterprise Data Integration
✔ Performance Tuning and Cost Optimization
Preferred Experience
🔹 Building AI-powered analytics and conversational BI solutions
🔹 Implementing enterprise RAG architectures using Vector Search
🔹 Designing semantic models and trusted data assets for self-service analytics
🔹 Supporting AI use cases through Mosaic AI model serving and inference endpoints
🔹 Enterprise cloud modernization and large-scale data platform migrations
Certification
🏅 **Azure Databricks Certified Data Engineer Professional** (Mandatory)
🏅 Additional Databricks Architect and Azure certifications are highly desirable