School of Medicine Established in 1930, Duke University School of Medicine is the youngest of the nation's top medical schools. Ranked sixth among medical schools in the nation, the School takes pride in being an inclusive community of outstanding learners, investigators, clinicians, and staff where interdisciplinary collaboration is embraced and great ideas accelerate translation of fundamental scientific discoveries to improve human health locally and around the globe. Composed of more than 2,500 faculty physicians and researchers, more than 1,300 students, and more than 6,000 staff, the Duke University School of Medicine along with the Duke University School of Nursing, Duke University Health System and the Private Diagnostic Clinic (PDC) comprise Duke Health. a world-class academic medical center. The Health System encompasses Duke University Hospital, Duke Regional Hospital, Duke Raleigh Hospital, Duke Primary Care, Duke Home and Hospice, Duke Health and Wellness, and multiple affiliations.

Position Summary 

This position is responsible for designing, developing, and validating machine learning products and systems within the scope of DIHI projects. This position will act as a liaison between product managers, data scientists, data engineers, and clinician users to determine the requirements for novel machine learning models. This position will assist with curation and quality assurance of data across diverse clinical and operational data sources and will collaborate closely with data engineers and solution architects to ensure that machine learning models are effectively integrated into clinical care. This position will work closely with the DIHI Program Director to identify and pursue opportunities to leverage emerging statistics and machine learning methods and technologies to drive impact within Duke Health. This role will participate in activities throughout the machine learning product lifecycle, including initial design, development, internal and external validation, temporal and clinical validation, impact and outcomes analyses, updating, and maintenance. This role will utilize statistics expertise to both develop machine learning systems as well as assist in the design and conduct of evaluation studies to measure the effect of algorithms integrated into clinical care. Lastly, this position will help teach students and trainees involved in DIHI workforce development programs. 

This position will possess expertise in statistics and machine learning and causal inference to effectively develop machine learning solutions to improve care at Duke Health and beyond. This role will work closely with business unit leaders and compliance and regulatory support staff, and success carrying out responsibilities will be strengthened by strong interest in business, ethics, law, and policy. This position will maintain comprehensive and contemporary knowledge of machine learning and statistics methods and best practices, with a focus on development and validation of products and systems in the health setting. This position reports directly to the DIHI Program Director. 

Duties and Responsibilities of Position: 

• Development, validation, and implementation of machine learning systems

• Works directly with data science lead, quantitative science trainees, and clinical trainees who are involved in model development and validation 
• Develops utilities and frameworks to standardize and enhance the development and validation of machine learning systems 
• Develops and updates monitoring systems to ensure that any implemented machine learning model continues to perform as specified 
• Reviews code and performs evaluations of previously built machine learning models before integration into technical infrastructure 
• Maintains contemporary knowledge of advances in machine learning to ensure that emerging technologies are incorporated into DIHI development efforts 

• Evaluation, monitoring, maintenance, and oversight of implemented machine learning systems 

• Works with clinical and operational leaders to define relevant outcome measures to demonstrate impact of machine learning products integrated into care 
• Designs and conducts evaluations of machine learning products to identify strengths and weaknesses of model integrations and improve practices across DIHI in regards to machine learning model development 
• Collaborates directly with data engineering and solution architect team members to optimize technology infrastructure for rapid implementation of machine learning systems 
• Defines model performance measures related to safety, efficacy, equity, and fairness to monitor and measure throughout the product lifecycle as well as standard reporting practices to diverse stakeholders 

• Identifies opportunities to enhance implementation and maintenance of machine learning systems, including automated reporting and notification to detect changes in model performance or unanticipated adverse events 
• Develops utilities to enable comparison of multiple model versions and rapid updating and evaluation of new model versions 

• Stakeholder engagement and requirements gathering 

• Works directly with clinical and operational stakeholders to identify requirements, map clinical and operational workflows to identify opportunities for new technologies, and prototype solutions 
• Maintains internal and external network to identify opportunities to leverage emerging methods and technologies to benefit DIHI projects and improve clinical care at Duke Health 

• Engages diverse stakeholders in design, validation, and evaluation of machine learning models to build trust and accountability in technologies that are built for integration into clinical practice 

• Diffusion and dissemination of machine learning products 

• Works directly with DIHI Program Director to identify opportunities to externally validate, diffuse, and commercialize machine learning solutions 
• Participates in dissemination efforts via academic writing, conference presentations, and internal and external communications related to DIHI projects 

The position assists and leads in performing the following functions: 

• Develops, evaluates, and implements machine learning models built for DIHI projects Develops and maintains machine learning model evaluation, monitoring, maintenance, and oversight frameworks and structures for DIHI projects 
• Engages diverse stakeholders in requirements gathering, technology design, development, and validation to build trust and accountability throughout product development lifecycle 
• Assists with the diffusion and dissemination of machine learning solutions within and beyond Duke Health 

Knowledge, Skills, and Abilities: 

• Strong background in statistics with experience developing, evaluating, and implementing machine learning models 

• Background in software development with experience in back-end and front-end development a plus 
• Strong background in Python programming 
• Strong background in data management including Oracle or SQL 
• Prior experience with clinical, EHR and/or administrative health data required. 
• Experience working closely with clinicians and researchers across biomedical research disciplines developing technologies for use in clinical care 

• Excellent analytical and problem-solving ability 
• Healthcare/Research industry experience required 
• Documenting and analyzing workflow and clinical processes 
• Creating data solutions to support business processes 
• 4 years of experience in machine learning model development and evaluation in health care industry 

Preferred Qualifications 

• Data science / machine learning with healthcare data 
• Experience bringing software products to market 
• Development of frameworks to support development, validation, impact assessment, and maintenance of data-driven software applications 

• Experience identifying strategic opportunities for novel development or use of technical methods 
• Knowledge of software development, machine learning, and technology infrastructure 

Job Code: 00002426 ANALYST, IT, SR
Job Level: D

Duke is an Affirmative Action/Equal Opportunity Employer committed to providing employment opportunity without regard to an individual's age, color, disability, gender, gender expression, gender identity, genetic information, national origin, race, religion, sex, sexual orientation, or veteran status.

Duke aspires to create a community built on collaboration, innovation, creativity, and belonging. Our collective success depends on the robust exchange of ideas—an exchange that is best when the rich diversity of our perspectives, backgrounds, and experiences flourishes. To achieve this exchange, it is essential that all members of the community feel secure andwelcome, that the contributions of all individuals are respected, and that all voices are heard. All members of our community have a responsibility to uphold these values.

Essential Physical Job Functions: Certain jobs at Duke University and Duke University Health System may include essential job functions that require specific physical and/or mental abilities. Additional information and provision for requests for reasonable accommodation will be provided by each hiring department.