What are the responsibilities and job description for the Data Fabric Developer - Buffalo, NY position at Lorven Technologies, Inc.?
Our client seeks an Data Fabric Developer for a 12 Months project in Buffalo, NY. Below is the detailed requirement
Job Title: Data Fabric Developer
Work location : Buffalo, NY
Duration: 12 Months
Job Description:
- Bachelor's degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12 Minimum Experience
- Development & Migration: Develop and maintain ADF pipelines, PySpark notebooks, and T-SQL solutions to migrate on-premises workloads to Microsoft Fabric.
- Storage & Format Optimization: Manage data storage strategies using ADLS Gen2 and OneLake; optimize data ingestion and processing by leveraging Parquet files and Delta Parquet tables for performance and reliability.
- Warehouse Management: Develop, manage, and optimize data models within the Microsoft Fabric Warehouse to support enterprise reporting and analytics.
- Data Transformation: Implement complex data transformations, validation rules, and automated load processes.
- Testing & Quality Assurance: Perform unit testing, manage defect resolution, and support integration and User Acceptance Testing (UAT) cycles.
- Performance Tuning: Optimize SQL queries, ETL processes, and compute usage to ensure system scalability and cost-efficiency.
- Process Compliance: Follow established coding standards, documentation practices, and deployment procedures.
- Collaboration & Support: Work alongside architects and leads to interpret design specifications, resolve technical roadblocks, and provide production support for data environments.