What are the responsibilities and job description for the Databricks Architect position at MSR Technology Group?
Databricks Architect
Remote
Full-time
Must Have Technical/Functional Skills
- Experience: 5 years of hands-on data engineering experience, with at least 3 years focused on the Databricks/Spark Ecosystem
- Databricks Expertise: Deep, hands-on expertise with the Databricks Lakehouse Platform, including Delta Lake, Structured Streaming, Delta Live Tables, and cluster configuration/optimization.
- Programming Mastery: Expert-level proficiency in Python and PySpark.
- Advanced SQL skills are essential.
- Data Warehousing Concepts: Strong understanding of data modeling principles, including dimensional modeling (Kimball), data warehousing concepts, and ETL/ELT design patterns.
- Cloud Proficiency: Proven experience working with a major cloud provider (Azure, AWS, or GCP), particularly with data storage S3 and related services.
- Software Engineering Mindset: Experience with software engineering best practices, including version control (Git), code reviews, testing, and CI/CD.