What are the responsibilities and job description for the Psychometrician position at American Board of Internal Medicine?
The American Board of Internal Medicine (ABIM) is currently seeking a Psychometrician to join our team. In this role, the Psychometrician is responsible for leading the psychometric activities for examinations and facilitating improvements to psychometric methods, processes, and relevant issues in the evaluation of medical knowledge and education.
Reporting to the Manager, Psychometric Operations, the Psychometrician has the following primary responsibilities:
- Facilitate/perform item analysis, IRT calibrations, scoring, equating, standard setting, and validity and reliability studies for several certification examinations.
- Develop, maintain, and/or improve operational psychometric processes
- Collaborate with subject matter experts and exam developers in item development and review processes and exam design, development, and review processes.
- Report examination results and related research to physician and non-physician audiences.
- Provide oversight and support for data analysts in research projects and operational work.
- Handle inquiries (by phone and in writing) related to examination scoring.
- Collaborate on research and development projects within and across departments and communicate results to the board and to the research community.
- Advise on research, measurement, statistical, and systems issues.
- Plan for projects by anticipating work and the required resources, and understand the importance of operational and project planning processes as it relates to the use of company’s fiscal and human resources.
The ideal candidate has a doctorate degree in educational/psychological measurement, statistics, or related field with zero to three years’ experience and has the ability to effectively use statistical analysis programs and IRT software including (but not limited to) SAS and R. In addition, experience in the principles and application of psychometrics including item response theory (i.e., item calibration, item evaluation, linking/equating, and IRT scoring), classical test theory, and standard setting. To thrive in this role at ABIM, one must have excellent communication, organizational, planning and problem-solving skills.
This role is based in our offices at 510 Walnut Street, Philadelphia PA, with the ability to work remotely three days a week. Our technology and facility teams provide and support a seamless hybrid work environment for all employees.
* * *
At the American Board of Internal Medicine (ABIM), our team of unique and talented professionals, and the inspiring work they do, are essential to meeting the needs and expectations of ABIM’s diverse community of physicians.
ABIM is like no other workplace, and we are proud of it. We are committed to recognizing the importance of our people by investing in their lives through ongoing learning opportunities and exceptional total compensation & benefit offerings.
We look forward to learning more about your interest in joining our team. Apply online, or email your resume to careers@abim.org. EOE