As a Psychometrician at Kryterion, you equally enjoy client-facing work as well as running statistical analyses. You have experience performing all of the typical test development and maintenance activities from beginning to end. Although you enjoy working independently, you like to collaborate closely with other team members. You exercise sound judgment as to when to escalate issues.
Our Values
We Own It We Face Challenges with Optimism
We are one team We Build Trust
We Listen and Learn From Each Other We Help Our Customers Succeed
We Continuously Improve
Key Responsibilities:
• Conduct job task analysis studies (e.g., facilitate focus group, construct job analysis surveys, monitor survey administration, analyze data, and report on the results)
• Develop test blueprint/specifications (e.g., calculate draft test blueprint, facilitate meeting with subject matter experts)
• Facilitate item development and technical review workshops, committee meetings, and training sessions
• Oversee the maintenance of item banks and perform quality control procedures of item banks, including overseeing item edits, item coding (e.g., test blueprint link, status), and enemy item identification
• Perform Classical Test Theory (CTT) exam and item analysis studies, make recommendations, and review results with clients
• Review Item Response Theory (IRT) exam and item statistics, make recommendations and review results with clients
• Perform standard-setting studies (e.g., Modified Angoff), including facilitating subject matter expert meetings, analyzing data, making cut score recommendation, and reporting results
• Conduct equating studies based in CTT and have familiarity with IRT equating methodologies
• Write technical reports (e.g., job task analysis, standard setting)
• Recommend and oversee test maintenance activities (e.g., test form revisions, replacement of beta test item sets)
• Create project plans and coordinate, prioritize, and complete project activities within contractual timelines and budget
• Ensure the quality of every work product produced is in accordance with client, company, and industry standards
• Make recommendations on test development and psychometric concepts to internal and external audiences and communicate in an understandable manner
• Provide guidance for accreditation applications (e.g., NCCA, ANSI/ANAB)
• Attend industry conferences to serve as a psychometric resource for the sales and marketing team, as well as to gather leading industry knowledge
• Perform other duties as assigned by supervisor
Qualifications:
• Minimum of a Master's or Doctorate degree in Educational Measurement, Educational Statistics, Industrial/Organizational Psychology, or a related field required.
• Minimum of 3 years of experience in the Certification and Licensure industry
• Excellent oral and written communication skills
• Well-developed analytical and problem-solving abilities
• Strong project management and time management skills
• Outstanding Microsoft Excel and Word skills
• Proficiency with SPSS statistical software
• Extremely detail-oriented and committed to accuracy
• Must be able to work independently with minimal supervision.
• Some travel is required - up to 25%; client workshops often occur over weekends so a willingness to work weekends is required.
** Though this role will be generally remote, the role will require travel up to 25% of the time.