What are the responsibilities and job description for the Technology Architect - Databricks position at N Consulting Ltd?
Work mode: HybridNumber of days a week worked in the office: 3Contract duration: 8 monthsLocation: LondonEnd client: Bank---------------------------------------JOB DETAILSRole Title: Technology ArchitectTechnology Architect – Databricks with over 12 years of experience in designing and leading large scale data engineering, analytics, and cloud transformation initiatives.The ideal candidate will have deep expertise in Databricks, big data architectures, cloud platforms (Azure), and modern data engineering frameworks.This role will be responsible for defining end to end architectural solutions, driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms.* Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads.* Define data ingestion, transformation, governance, and consumption frameworks aligned to enterprise standards.* Evaluate and recommend architectural improvements, new tools, and emerging technologies.* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations.* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows.* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage.* Guide teams in building curated, governed data models leveraging Delta Lake Medallion Architecture (Bronze–Silver–Gold).
Salary : $400 - $465