What are the responsibilities and job description for the Databricks Technical Architect position at Onebridge?
Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Databricks Technical Architect to join our innovative and dynamic team.
Databricks Technical Architect | About You
As a Databricks Technical Architect, you are responsible for defining the strategic architecture and delivering scalable, high-performance data solutions leveraging Databricks. You have a proven ability to influence senior leadership and align technology decisions with business objectives. You excel at designing modern data platforms, optimizing workflows, and enabling advanced analytics capabilities across large-scale environments. You thrive in Agile settings, collaborating with cross-functional teams to translate complex business requirements into actionable technical solutions. Your expertise in Databricks, medallion architecture, and AI/ML integration positions you as a trusted advisor for enterprise data transformation initiatives.
Databricks Technical Architect | Day-to-Day
- Collaborate with business and technology stakeholders to define target architecture, roadmaps, and best practices for enterprise data platforms.
- Design and implement scalable data solutions using Databricks, including medallion architecture, Delta Live Tables (DLT), and Unity Catalog.
- Develop and optimize data pipelines for batch and real-time ingestion, ensuring performance, reliability, and cost efficiency.
- Establish standards for data governance, security, and compliance within Databricks and integrated cloud environments.
- Lead architecture reviews, code assessments, and knowledge-sharing sessions, promoting best practices across teams.
- Integrate advanced analytics and ML/AI capabilities into data workflows to enable predictive insights and automation.
Databricks Technical Architect | Skills & Experience
- 10 years of enterprise Data Architecture experience, with deep expertise in designing and implementing solutions on Databricks.
- Extensive hands-on experience with Databricks fundamentals, including cluster optimization, Delta Lake, MLflow, and SQL Warehouse.
- Proven ability to architect big data solutions using Data Lakes, Data Warehouses, and Data Products at scale.
- Experience building real-time and batch ingestion pipelines, leveraging technologies such as Spark, PySpark, and Delta Live Tables.
- Strong knowledge of data governance, security, DevOps, and MLOps practices for modern data platforms.
- Familiarity with cloud platforms (AWS, Azure, GCP) and hybrid architectures is a plus.
- Exposure to advanced analytics and AI/ML techniques, enabling integration of predictive models into enterprise workflows.