Psychometrician

Job Description

Job Title: Psychometrician

Reports to: Director of Psychometrics

FLSA: Exempt

Manages others: No

Location: Hybrid or Remote

Department: Research & Development

General Job Description: The psychometrician’s primary responsibility is to execute, review, and interpret data analyses related to the development of psychological assessments. This requires experience with and understanding of reliability, validity, factor analysis, ROC analysis, IRT, and other common psychometric data needs. The successful candidate will have a strong background in data analysis using a variety of theories and statistical packages and will have a minimum of three years’ experience in applied settings. The successful candidate will demonstrate strong attention to detail, an understanding of how data support the utility of psychological assessment, ability to collaborate well with others, and a willingness to learn and grow.

Essential Responsibilities:

• Assist R&D Director of Psychometrics and Project Directors with all required psychometrics analyses with minimal oversight. Execute routine operational psychometric analyses assigned, including but not limited to item analysis, person analysis, reliability and validity analyses, scoring, using standard and customized psychometric analysis tools.
• Apply methods such as classical test theory, item response theory, and other psychometric models to optimize assessment effectiveness.
• Run code, organize and review results, and discuss findings with the Director of Psychometrics and other R&D staff.
• Recommend additional or alternate analytic approaches to Project Directors to support better decision-making.
• Apply knowledge of clinical assessment to review and verification of analysis results.
• Ensure the accuracy, reliability, and validity of diagnostic products through rigorous validation studies.
• Document all processes, datasets, analytic results, and code.
  
  

 

Position Requirements (Skills, Knowledge, Abilities):

This position requires a deep understanding of psychometric theory and its application, including knowledge of IRT, CTT, statistics and scoring methods.

• Master’s degree in psychometrics, educational measurement, psychological measurement, or a related quantitative field.
• Three years of post-graduation experience in the field of psychometrics in applied settings (psychological or educational testing strongly preferred).
• Expertise in statistical software (e.g., R, SPSS) and programming languages (e.g., Python).
• Demonstrated experience with or genuine interest in integrating AI tools into data analysis workflows (e.g., Claude Code, Copilot, LLM-assisted scripting).
• Ability to work independently to meet timelines/deadlines by applying the principles of project management and adapting in response to changes in work priorities and processes.
• Ability to identify errors and solve problems.
• Ability to execute assigned analyses and seek support when needed.
• Excellent interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.
  
  

Competencies Required:

• Analytic judgment — The ability to select, apply, and defend appropriate methods in the face of ambiguous or complex data problems; comfort operating without a prescribed analytic template.
• Consistency and Reliability - The capacity to feel an internal motivation to be conscientious in personal or professional efforts; the need to be consistent and reliable in life roles.
• Problem-Solver - Ability to identify, analyze, and solve a problem in support of personnel, group, department, or organizational objectives.
• Results Orientation - The ability to identify actions necessary to achieve task completion and to obtain results; the ability to meet schedules, deadlines, quotas, and performance goals.
  
  

Physical Requirements:

(The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable Accommodations may be made to enable individuals with disabilities to perform the essential functions.)

• The employee may regularly lift and /or move up to 10 pounds and occasionally lift and/or move up to 20 pounds.
• Specific vision abilities required by this job include Close vision and Distance vision.
• The auditory/hearing abilities required by the job include the ability to hear others using a phone or online conferencing system.
• While performing the duties of this Job, the employee is regularly required to use hands to finger, handle, or feel; reach with hands and arms and talk or hear.
• The employee is regularly required to walk and sit for prolonged periods.
• This individual must be a responsible person and regular attendance is required.
  
  

WPS IS AN EQUAL OPPORTUNITY EMPLOYER AA M/F/V/D.

We proudly hire U.S. Military Veterans, and those qualified are encouraged to apply.

Equal Employment Opportunity is The Law. | Pay Transparency Nondiscrimination Provision