What are the responsibilities and job description for the Azure Data Engineer (Microsoft Fabric expert) position at Ohm Systems, Inc?
Must Have: Microsoft Fabric , Azure Data Services & Devops
Job Summary:
Seeking an experienced Azure Data Engineer to build, support, and optimize enterprise data pipelines using Microsoft Fabric and Azure Data Services. The ideal candidate will have strong hands-on experience with Spark, Azure Data Factory, and real-time data processing.
Key Responsibilities:
- Develop and maintain data pipelines using Microsoft Fabric and Azure Data Factory
- Build and optimize Spark (PySpark) ETL workflows
- Support batch and real-time data processing with Azure Event Hub & Stream Analytics
- Monitor production pipelines, troubleshoot issues, and optimize performance
- Manage Lakehouse architecture (Delta/Parquet)
- Write efficient SQL queries and support Azure SQL/Cosmos DB
- Support CI/CD deployments and operational documentation
Required Skills:
- 9 years of Azure Data Engineering experience
- Strong Microsoft Fabric (Spark, Lakehouse, Pipelines) expertise
- Experience with Azure Data Factory, Event Hub, and Stream Analytics
- Strong PySpark and SQL skills
- Azure SQL/SQL Server experience (Cosmos DB preferred)
- Experience with distributed data systems and Azure DevOps/CI-CD