What are the responsibilities and job description for the Senior Data Engineer position at IDR Inc.?
IDR is seeking a Senior Data Engineer to join one of our top clients for an opportunity in Louisville, Kentucky. This role entails supporting the organization’s efforts to consolidate and modernize healthcare data systems into a scalable analytics environment, enabling advanced reporting and decision-making across various business lines in healthcare, pharmacy, and operational sectors.
Position Overview for the Senior Data Engineer:
- Support data warehousing in a Databricks and Azure SQL environment by designing, building, and maintaining scalable, reliable data pipelines and models.
- Ingest data from diverse sources including EHR, claims, billing, and pharmacy systems, ensuring high data quality, governance, and compliance.
- Collaborate with stakeholders to develop data solutions that support clinical, financial, and operational analytics.
- Create and optimize data pipeline architectures, automating manual processes and improving scalability.
- Ensure data security and compliance across Azure regions, supporting enterprise standards for privacy and governance.
Requirements for the Senior Data Engineer:
- Bachelor’s degree in computer science, statistics, informatics, information systems, or related field.
- 10 years of experience in a Data Engineer or BI Developer role.
- Extensive SQL experience including complex query development, SSIS, and performance tuning.
- Experience with data lake and data lakehouse architectures, particularly Delta Lake, and building data pipelines using Databricks and Spark.
- Strong scripting skills in Python and/or Scala, and familiarity with Azure cloud services such as Databricks, Azure Data Factory, and Azure Data Lake.
What's in it for you?
- Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25 Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.
Location/Region: Louisville, Kentucky