Microsoft Data Engineer

In this role, you will be instrumental in supporting the development and maintenance of our data pipelines and data warehouse built on the Microsoft ecosystem. You will work alongside experienced data engineers and analysts to ensure the smooth flow and accessibility of data across the organization.

Responsibilities

• Assist in the design, development, and maintenance of ETL processes leveraging tools and technologies within the Microsoft ecosystem (e.g., SSIS (SQL Server Integration Services), ADF (Azure Data Factory).
• Develop and maintain SQL scripts, stored procedures, functions, and views in Microsoft SQL Server.
• Implement best practices for data modeling and schema design within SQL Server.
• Contribute to the performance tuning and optimization of SQL queries and database processes.
• Collaborate with data analysts and scientists to understand their data requirements and provide them with well-structured data from SQL Server.
• Participate in the implementation of data quality checks and validation rules within the SQL Server environment.
• Assist in the documentation of database schemas, ETL processes, and data flows related to SQL Server.
• Stay current with the latest features and best practices related to Microsoft SQL Server and Azure data services.
• Troubleshoot data-related issues within the SQL Server environment and related pipelines.
• Contribute to the automation of data-related tasks using SQL Server Agent or other scripting tools.
• Ability to gather client data requirements for ETL, Database, and Business Intelligence development.
  
  

Qualifications/Skills Required

• Minimum of 3 to 5 years of experience working with ETL and database development in SQL Server.
• Solid understanding of relational database concepts and strong proficiency in SQL, specifically with Microsoft SQL Server.
• Experience with the following tools
  
  

SQL Server

• SSIS (SQL Server Integration Services)
• SSMS (SQL Server Management Studio)
• SSDT (SQL Server Data Tools)
• SSRS (SQL Server Reporting Services)
  
  

Visual Studio

• Familiarity with data visualization tools that connect to SQL Server (e.g., Power BI)
• Understanding and ability to apply SQL Server indexing strategies to meet expected query workloads (e.g., OLAP vs OLTP).
• Experience with version control systems (e.g., GitHub).
• Experience with database development in Visual Studio using SSDT (SQL Server Data Tools)
• Excellent problem-solving and analytical skills with a focus on data accuracy and integrity.
• Strong communication and collaboration skills.
• A proactive and eager attitude towards learning new Microsoft data technologies.
• Ability to work effectively both independently and within a team.
  
  

Bonus Points

• Exposure to other Microsoft Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage).
• Familiarity with the concept of Data\Lakehouse design.
• Experience with scripting languages like PowerShell or Python.
• Experience with common Python Packages like
• Pandas
• SQLAlchemy
• pyodbc
• requests
• Airflow
• PySpark
• Experience with cloud-based database systems (e.g., Snowflake, BigQuery)
• Experience with Azure SQL databases.
• Understanding of SQL Server PolyBase.
• Familiarity with the Avro and Parquet data formats.
• Understanding of data warehousing methodologies and dimensional modeling.
  
  

Educational Requirements

• Bachelor's degree in computer science, Data Science, Information Technology, or a related quantitative field.