What are the responsibilities and job description for the Data Engineer (Databricks SME) position at IDR, Inc.?
IDR is seeking a Data Engineer (Databricks SME) to join one of our top clients for a remote opportunity. This role involves designing and implementing scalable data solutions, supporting AI-ready data processing, and collaborating with cross-functional teams to enable data-driven decision-making.
Position Overview for the Data Engineer (DatabricksSME):
- Assist in developing modern data pipelines and architectures to support analytics and machine learning initiatives.
- Collaborate with stakeholders to translate business requirements into technical data solutions.
- Support data governance, transformation, and integration efforts in a cloud environment, primarily using Azure Databricks.
- Develop and monitor metrics for data quality and system performance.
- Contribute to evolving enterprise data strategies and best practices.
Requirements for the Data Engineer (Databricks SME):
- 5 years of experience in data engineering and/or data warehousing.
- 4 years of hands-on experience with Azure Databricks.
- Experience supporting AI-ready data solutions, including data preparation and transformation for analytics, machine learning, and generative AI.
- Proficiency in Python for data-related tasks and system integration.
- Mastery of TSQL and ANSI SQL, with experience using version control platforms like Git.
What's in it for you?
- Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25 Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row
- pay transparency: 105-115k/year in USA or 145-165k/year in Ontario, CAN