What are the responsibilities and job description for the Senior Data & Databricks Architect (US Citizen only) position at Sophus IT Solutions?
About the Company
Sophus It solution is looking for an Senior Data Security & Databricks Architect. Our mission is to provide innovative IT solutions that empower businesses to achieve their goals. We foster a culture of collaboration, creativity, and continuous improvement.
About the Role
We are seeking an experienced Senior Data Security & Databricks Architect with over 10 years of expertise in data engineering, data governance, and platform security. This role focuses on designing and implementing secure, scalable data solutions within the Databricks Lakehouse ecosystem, with a strong emphasis on PHI/PII protection, data classification, and AI-enabled data access.
Responsibilities
- 10 years of experience in data engineering, data architecture, or data security roles.
- Strong hands-on experience with Databricks Lakehouse platform.
- Proven expertise in PHI/PII data handling, data classification, and compliance frameworks.
- Deep knowledge of data security techniques, including:
- Data masking
- Encryption
- Data minimization
- Experience working with modern table formats:
- Delta Lake
- Apache Iceberg
- Interoperable data architectures
- Strong understanding of cloud platforms, especially Microsoft Azure.
- Experience integrating Databricks with Snowflake or similar data platforms.
- Hands-on experience building data dashboards and monitoring frameworks within Databricks.
- Expertise in RBAC implementation and access control frameworks.
- Experience with AI/ML integrations and enabling self-service analytics platforms.
- Proficiency in Python, SQL, and Spark (PySpark/Scala).
- Experience building scalable data applications and APIs within Databricks.
- Strong knowledge of performance optimization techniques, including caching and query tuning.
Required Skills
Strong hands-on experience with Databricks Lakehouse platform, proven expertise in PHI/PII data handling, data classification, and compliance frameworks, deep knowledge of data security techniques, and proficiency in Python, SQL, and Spark (PySpark/Scala).
Preferred Skills
Experience integrating Databricks with Snowflake or similar data platforms, hands-on experience building data dashboards and monitoring frameworks within Databricks, and expertise in RBAC implementation and access control frameworks.