What are the responsibilities and job description for the Data Lake Engineer 1 position at InstantServe LLC?
Job Title:Data Lake Engineer 1
Location: Remote or Hybrid - Saint Paul, MN
Position Overview:-
We are seeking an experienced Azure Data/Database Engineer to support a major modernization initiative involving the development of a Comprehensive Child Welfare Information System (CCWIS).
The selected candidate will help consolidate data from multiple county-level databases into a centralized Azure Data Lake/Data Lakehouse environment that will support a modernized enterprise system.
The engineer will be responsible for the design, development, implementation, administration, security, performance optimization, and ongoing support of Azure databases and data lake solutions. The role will work closely with cross-functional teams and provide technical guidance and knowledge transfer to other database engineers.
Required / Desired Qualifications:-
Location: Remote or Hybrid - Saint Paul, MN
Position Overview:-
We are seeking an experienced Azure Data/Database Engineer to support a major modernization initiative involving the development of a Comprehensive Child Welfare Information System (CCWIS).
The selected candidate will help consolidate data from multiple county-level databases into a centralized Azure Data Lake/Data Lakehouse environment that will support a modernized enterprise system.
The engineer will be responsible for the design, development, implementation, administration, security, performance optimization, and ongoing support of Azure databases and data lake solutions. The role will work closely with cross-functional teams and provide technical guidance and knowledge transfer to other database engineers.
Required / Desired Qualifications:-
- Approximately 7 years of experience designing, developing, and implementing databases and data lake solutions.
- Strong hands-on experience with Microsoft Azure data and database services.
- Experience designing and implementing Azure Data Lake/Data Lakehouse architectures.
- Hands-on experience with Azure Databricks.
- Strong experience with Azure Data Factory and data transformation solutions.
- Strong experience with Azure SQL Database, including knowledge of:
- Azure SQL instances
- Managed Instances
- Elastic Pools
- Strong experience with Oracle databases.
- Experience with relational and non-relational database technologies.
- Strong knowledge of data modeling, schema design, indexing, and database architecture.
- Experience developing and implementing ETL/ELT and data-loading solutions.
- Experience with CI/CD pipelines and cloud infrastructure integration.
- Experience with Azure DevOps or comparable CI/CD technologies.
- Experience using Azure Monitor, SQL Analytics, and Query Performance Insight.
- Experience with Azure Resource Manager (ARM).
- Experience using Azure CLI and PowerShell.
- Knowledge of cloud computing concepts and Azure architecture.
- Experience implementing backup and recovery strategies, including Azure Backup and/or geo-replication.
- Strong understanding of RBAC, encryption, network security, and data security.
- Experience with database performance monitoring and optimization.
- Knowledge of Data Warehouse Administration and Teradata Data Warehouse is desirable.
- Strong communication, organizational, and time-management skills.
- Ability to mentor and provide technical guidance to other engineers.