What are the responsibilities and job description for the Data Architect position at TekShapers?
Position: Data Architect (Databricks Lakehouse)
Location: NYC NY
Duration: 6 Months
Job Details:
- Own the target-state architecture in Databricks and actively contribute to pipeline development.
- Define how API/FTP data flows into Bronze/Silver/Gold layers with cleansing and enrichment logic.
Key Responsibilities
- Design Databricks Lakehouse architecture (Bronze/Silver/Gold)Define ingestion patterns for API & FTPArchitect scalable cleansing & enrichment frameworksTranslate legacy SQL logic into Spark-based transformations
- Define Delta Lake optimization strategy Establish security, governance, and PHI controlsImplement CI/CD for data pipelinesMentor engineering teamRequired
- SkillsStrong expertise in Databricks & Delta LakeAdvanced PySpark & Spark SQL
- Experience designing data pipelines from scratch Strong understanding of SQL Server logic & stored procedures Azure cloud experience
- Healthcare data architecture experience preferred
“Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.”