What are the responsibilities and job description for the Data Engineer position at Novalink Solutions LLC?
DHHS-ITD is seeking a Data Engineer for development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics and Power BI for the Child Welfare Program.
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Data Engineer for the development and optimization of data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
- Synapse
- Design, Develop and maintain data models in Synapse to support reporting and analytics
- Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
- Analyze the source system and design the ETL data load.
- Ability to create and configure Azure Synapse Analytics workspace.
- Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like Salesforce.
- Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
- Power BI Tools
- Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Requirements
Skill
Required / Desired
Amount
of Experience
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows
Required
3
Years
Required
3
Years
Programming Languages: Strong proficiency in Python or Scala for data processing.
Required
3
Years
Required
3
Years
SQL Mastery: Advanced query writing, performance tuning, and optimization.
Required
5
Years
Required
5
Years
Hands-on experience in developing efficient PL/SQL procedures
Required
5
Years
Required
5
Years
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization)
Required
1
Years
Required
1
Years
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database)
Highly desired
1
Years
Highly desired
1
Years
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage
Highly desired
1
Years
Highly desired
1
Years
Experience with Power BI
Nice to have
1
Years
Nice to have
1
Years
