Psychometrician

POSITION OVERVIEW

NBME®'s Psychometrics and Data Analysis (PADA) unit is seeking a Psychometrician to join their team. When applying, interested candidates should include a cover letter to indicate their interest in and fit for the role. This position is expected to make contributions in four primary areas:

• Planning and execution of psychometric analyses, scoring, and score reporting for operational examination programs.
• Applied research and development in support of examination programs, analysis methods, and procedures.
• Contribute to the educational measurement community via professional presentations and publications related to independent and organizational research agendas.
• Evaluate existing procedures for improvement opportunities and identify new methods or applications of technology to increase accuracy and efficiency of exam processing.

The Psychometrician role must effectively collaborate with a variety of internal staff, including data analysts, test developers, information technologists, and program managers. In addition, the psychometrician is expected to be skilled in supporting external facing communication and engagement with clients and subject matter experts from a wide range of medical and health care fields.

Operational examination programs at NBME include the United States Medical Licensing Examination®, an extensive medical school examination program that supports the assessment needs of US and international medical schools, and numerous client examinations primarily in support of medical specialties. The variety of assessment programs creates a wealth of data and opportunities for applied and theoretical research that can impact practice.

This role has been designated as primarily remote, meaning it generally does not require onsite work more than an average of 2-3 times per month and may require additional prescheduled onsite work. You are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We are open to considering candidates in the following states: Pennsylvania, New Jersey, Delaware, Maryland, Florida, Georgia, Iowa, Indiana, Kansas, Kentucky, Michigan, North Carolina, South Carolina, Tennessee, Texas, and Virginia.

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come.

QUALIFICATIONS

Skills and Abilities

• Strong background in psychometric theory and application, including knowledge of IRT, CTT, statistics, test development procedures, and research design.

• Advanced knowledge of measurement topics such as equating, scaling, generalizability theory, Bayesian methodology, or standard setting.

• Knowledge and/or experience in natural language processing, process data analytic methods, or formative assessment approaches is desirable.
• Excellent computer skills and a working knowledge of statistical software (e.g., Calibration software, SAS, Python, R).
• Excellent oral and written communication skills.
• Ability to identify errors and solve problems.
• Excellent interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Experience

A minimum of one year of experience is required to be considered for Psychometrician. Rank and responsibilities will be commensurate with experience.

Education

Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required. Candidates who are ABD and near completion are encouraged to apply.

About NBME

NBME is a not-for-profit organization that specializes in the creation of assessments and learning tools for physicians and health professionals. Our mission is to advance assessment of these professionals to achieve optimal care for all, supporting the development of a highly effective, diverse and compassionate health care workforce.

Founded in 1915, NBME develops and manages the United States Medical Licensing Examination® with the Federation of State Medical Boards. We offer a comprehensive portfolio of assessment products for every stage of the medical school journey and provide assessment services to various health profession organizations.

We are dedicated to advancing innovative assessment approaches through research, collaboration and contributions to the medical education and assessment communities. In 2024, we expanded our assessment capabilities to include simulation through the acquisition of MedVR Education.

Learn more on NBME's website.

NBME's Community Collaborations and Contributions

NBME believes that a key path to meeting our mission is collaborating with and supporting our communities. Our Community Collaborations and Contributions programs provide resources and recognition to medical educators and researchers advancing the field of assessment throughout their careers. In addition, we invest in fee assistance, scholarships and pathway programs to aid learners and help support increased representation in health care. Headquartered in Philadelphia, NBME also gives to local organizations that advance health equity and access and positively impact social determinants of health.

The compensation we are offering for this position is as follows:

PhD or other Doctoral degree in educational/psychological measurement, statistics, or a related field and at least two years of related professional experience: $113,689 - $142,112

PhD or other Doctoral degree in educational/psychological measurement, statistics, or a related field and at least four years of related professional experience: $138,720-$173,400

Please note that the offered rate for this position typically aligns with the minimum to midrange of this grade, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

Salary : $113,689 - $142,112