What are the responsibilities and job description for the Data Engineer (Microsoft) position at STEM Search Group?
What you’ll do…
- Build and optimize robust data pipelines using a blend of modern programming and traditional enterprise tools including C#, Python, SSIS, and Microsoft SQL Server versions 2019 through 2025.
- Design and implement custom data warehouse solutions and data structures to ensure high data availability, cleansing, and seamless integration for downstream business consumption.
- Collaborate closely with the data science team to integrate their R-based models and prototypes into reliable production workflows.
- Work closely with an established team of eight data engineers, a principal engineer, and external consultants to manage existing systems while selectively leveraging Databricks for cloud data processing.
- Participate actively in a collaborative agile environment by contributing to work estimates, following clean coding practices, and maintaining comprehensive documentation.
What we’re looking for…
- Proven experience designing production-grade data pipelines, custom data models, and enterprise data warehouse solutions.
- Extensive hands-on experience working with Microsoft SQL Server platforms, specifically versions 19, 22, and 25, alongside building complex ETL processes with SSIS.
- Solid proficiency writing and debugging code in both C# and Python, paired with the ability to interface effectively with data science outputs.
- Familiarity with Databricks environments to effectively support evolving cloud and big data initiatives.
- A team-oriented mindset with excellent problem-solving skills, comfortable working in a hybrid environment requiring three days in-office and two days remote.
- Comfort navigating software development lifecycles and source control, along with a readiness to complete a programmer aptitude test as part of the evaluation process.
- A desire to grow with AI as it relates to data warehousing and data engineering.