What are the responsibilities and job description for the Databricks Lead/Architect position at Euclid Innovations?
Databricks Lead/ Architect
Kansas City, KS
12 Months Contract
Project Context:
Customer is undergoing a large-scale migration from Teradata to Databricks over the last 18 months. Bronze layer lake hydration is still in progress, with a medallion architecture bronze, silver and gold layers supporting domain-based transformations. Hundreds of MIS reports currently running on Teradata must be successfully migrated and validated in the target Databricks environment. The client requires immediate implementation and subsequently scalable testing services.
Key Requirements:
Strong expertise in Databricks Lakehouse architecture
Hands-on experience with Databricks DLT Meta (Delta Live Tables) (not Unity Catalog)
Expertise in using Azure
Expertise in CI/CD implementation in Azure DevOps for deployment pipelines
Experience designing scalable testing and validation frameworks for data migration projects
Proven experience in Teradata to Databricks migration programs
Ability to support bronze, silver, and gold layer implementation and optimization
Strong understanding of enterprise reporting/data reconciliation processes
Preferred talent profile:
Senior Data Leads / Engineers with real project implementation expertise (not just trained/certified resources)
Very strong communication and solution mindset who have been there done that
Experience handling large-scale enterprise data transformation programs
Ability to work in hybrid onsite/offshore delivery model
Salary : $70 - $75