What are the responsibilities and job description for the Psychometrician position at Nightingale Education Group?
Position Summary:
The Psychometrician serves as Nightingale College's lead expert in measurement science and competency evaluation within its online nursing education environment. Sitting within the Data & Technology department, this role partners closely with nursing faculty and curriculum designers to ensure every assessment produces reliable, valid, and defensible evidence of learner competency — translating measurement science into clinical readiness signals that are statistically sound and regulator-ready.
Role and Responsibilities:
Assessment Design & Validation
$89,000—$98,000 USD
All new hires are required to attend New Collaborator Orientation (NCO) in Salt Lake City, Utah. The College will cover travel, lodging, and other accommodations.
Nightingale's commitment to diversity and inclusion is reflected both in our learners and collaborators because we believe the best outcomes for learners from underserved and diverse populations are achieved through collaborators with similar backgrounds and cultures. Nightingale Education Group is an equal opportunity employer.
Our Mission (not just words on the wall, we live it, love it, and daily contribute to it): With the primary focus on higher learning in healthcare professions, Nightingale Education Group contributes to elevating education, health, and employment systems through facilitation of academic achievement, personal growth, and professional development of its learners, alumni, and collaborators, while serving diverse communities.
At Nightingale Education Group, our Innovative Education model helps transform rural health landscapes through our blended-distance learning platform. Every person involved with Nightingale Education Group helps to change the lives of our learners, our communities, and ultimately the world by adding to the quality of healthcare. We are proud to have graduated nearly 5,000 nurses serving communities in need. We are serious about our outcomes and have a little bit of fun getting there.
The professional and personal development of our learners and our collaborators is our company's foundation. Not only do we develop strategies that promote a positive work-life integration, but we also create an environment that invites you to become an expert in your field, be it through higher education or professional development. Put simply, we elevate employment, elevate health, and elevate education. We're so happy that you've found us!
Employment is contingent upon successful completion of a background check and drug screen.
The Psychometrician serves as Nightingale College's lead expert in measurement science and competency evaluation within its online nursing education environment. Sitting within the Data & Technology department, this role partners closely with nursing faculty and curriculum designers to ensure every assessment produces reliable, valid, and defensible evidence of learner competency — translating measurement science into clinical readiness signals that are statistically sound and regulator-ready.
Role and Responsibilities:
Assessment Design & Validation
- Design and validate scenario-based assessments and clinical judgment evaluations aligned to concept-based curriculum and NCLEX standards.
- Establish cut scores and performance standards using evidence-based methodologies including IRT, CTT, and Generalizability Theory.
- Operationalize the Clinical Judgment Measurement Model (CJMM) into scoreable item types that assess cue recognition, prioritization, and decision-making.
- Monitor reliability indices and gather validity evidence across content, construct, and criterion-related dimensions for all active assessments.
- Conduct item analysis, DIF reviews, and standard-setting studies (Angoff, Bookmark) to ensure defensible cut scores and bias-free measurement.
- Produce psychometric evidence packages that support accreditation reviews, progression decisions, and NCSBN/CCNE compliance.
- Analyze assessment data to surface learner performance trends, identify concept mastery gaps, and predict NCLEX readiness.
- Build dashboards and reports in Power BI or Tableau to support curriculum decisions, faculty calibration, and student progression.
- Retrieve and manipulate institutional data using SQL, R, Python, or SAS; integrate psychometric outputs into the broader Analytics team infrastructure.
- Design measurement frameworks for virtual simulation, skills-based demonstrations, and rubric-based clinical evaluations.
- Develop inter-rater reliability protocols and calibration processes to ensure consistent scoring across simulation modalities.
- Establish psychometric standards for rubric design, holistic scoring, and performance level descriptors at scale.
- Educate faculty and academic leaders on assessment validity, reliability, and psychometric data interpretation.
- Lead calibration sessions and translate measurement science into practical guidance for item writing, rubric design, and student feedback.
- Contribute to program development, curriculum review, and professional conferences relevant to educational measurement and nursing education.
- Performs other duties as assigned.
- Master's degree or higher in Psychometrics, Educational Measurement, Statistics, or a closely related quantitative field is required.
- Minimum of two – four years of experience in assessment, educational testing, research, or a closely related field is required.
- Demonstrated experience conducting validity and reliability analyses is required.
- Proficiency in statistical tools such as R, Python, SAS, or equivalent, and data visualization platforms (Power BI or Tableau) is required.
- Experience retrieving and manipulating data using SQL or similar database querying methods is required.
- Doctoral degree (PhD) in Psychometrics, Educational Psychology, or a related quantitative field is preferred.
- Experience in health professions or nursing education environments is preferred.
- Familiarity with NCLEX-style testing and the Clinical Judgment Measurement Model (CJMM) is preferred.
- Experience in competency-based, simulation-based, or online education settings is preferred.
$89,000—$98,000 USD
All new hires are required to attend New Collaborator Orientation (NCO) in Salt Lake City, Utah. The College will cover travel, lodging, and other accommodations.
Nightingale's commitment to diversity and inclusion is reflected both in our learners and collaborators because we believe the best outcomes for learners from underserved and diverse populations are achieved through collaborators with similar backgrounds and cultures. Nightingale Education Group is an equal opportunity employer.
Our Mission (not just words on the wall, we live it, love it, and daily contribute to it): With the primary focus on higher learning in healthcare professions, Nightingale Education Group contributes to elevating education, health, and employment systems through facilitation of academic achievement, personal growth, and professional development of its learners, alumni, and collaborators, while serving diverse communities.
At Nightingale Education Group, our Innovative Education model helps transform rural health landscapes through our blended-distance learning platform. Every person involved with Nightingale Education Group helps to change the lives of our learners, our communities, and ultimately the world by adding to the quality of healthcare. We are proud to have graduated nearly 5,000 nurses serving communities in need. We are serious about our outcomes and have a little bit of fun getting there.
The professional and personal development of our learners and our collaborators is our company's foundation. Not only do we develop strategies that promote a positive work-life integration, but we also create an environment that invites you to become an expert in your field, be it through higher education or professional development. Put simply, we elevate employment, elevate health, and elevate education. We're so happy that you've found us!
Employment is contingent upon successful completion of a background check and drug screen.