What are the responsibilities and job description for the Sr. Databricks Architect position at Sabio infotech?
Job Title: Senior Databricks Architect
Domain : Financial Services
Location : Dallas, TX/Florham Park, NJ
Key Responsibilities:
· Architect and implement end-to-end data solutions using Databricks Lakehouse Platform
· Design and develop scalable data pipelines using PySpark, Spark, and SQL
· Lead cloud data platform implementations on AWS/Azure/Google Cloud Platform
· Drive modernization of legacy data systems to cloud-native architectures
· Implement Medallion Architecture (Bronze, Silver, Gold layers)
· Ensure data governance, security, and compliance (especially for Financial Services)
· Collaborate with business stakeholders, data scientists, and engineering teams
· Optimize performance, cost, and reliability of data pipelines
· Mentor and guide data engineering teams and provide architectural leadership
Required Skills & Qualifications:
· 12 years of experience in Data Engineering / Data Architecture
· Strong expertise in Databricks, PySpark, and Spark ecosystem
· Hands-on experience with cloud platforms anyone (Azure, AWS, or Google Cloud Platform)
· Experience with data orchestration tools (Airflow, ADF, etc.)
· Solid understanding of data modeling, ETL/ELT, and distributed systems
· Experience with Delta Lake and Unity Catalog is a plus
· Strong knowledge of Financial Services domain (Banking, Insurance, Capital Markets)
· Excellent problem-solving and stakeholder management skills