What are the responsibilities and job description for the Fabric Data Engineer position at MSH?
Builds, maintains, and optimizes data ingestion pipelines, Lakehouse tables, transformation logic, data quality checks, and operational workflows within Microsoft Fabric.
Key Responsibilities:
• Architect and maintain medallion data frameworks.
• Build ingestion pipelines using Data Factory, Spark Notebooks, Dataflows Gen2, Event Streams, and Lakehouse connectors.
• Develop Silver/Gold transformations including cleansing, enrichment, merging, and standardization.
• Implement data quality checks, validation rules, auditing columns, and error-handling patterns.
• Optimize Lakehouse and Delta Lake operations (schema evolution, partitioning, Z-Order, caching, vacuum, compaction).
• Support production operations including monitoring, incident triage, defect resolution, and performance tuning.
• Create/Maintain mapping sheets, schema documentation, lineage diagrams, and runbooks.
• Coordinate with analytics teams to prepare model-ready Gold datasets.
• Participate in Agile ceremonies, design reviews, and technical planning.
• Support UAT, test data preparation, and validation activities.