What are the responsibilities and job description for the Evaluation Specialist position at Educology Solutions?
ESI is seeking an Evaluation Specialist that will spearhead the measurement and analysis of learning outcomes for technical and professional development programs, with a distinct focus on transit industry contexts. This role requires proven expertise in assessment design, curriculum evaluation, and the implementation of both traditional and blended learning solutions using modern LMS platforms. The successful candidate will also demonstrate advanced application of the Kirkpatrick Model for training evaluation, bringing insight and rigor to continuous learning improvement initiatives for operational and frontline transit personnel, as well as administrative support staff.
DUTIES & RESPONSIBILITIESArea Description
Learning Outcomes Measurement Design and implement processes to evaluate knowledge transfer, skills acquisition, behavioral change, and organizational results as per the Kirkpatrick Model (Levels 1–4).
Assessment Design Create and validate formative and summative assessments (e.g., quizzes, skills checks, practical demonstrations) tailored for transit industry training curricula, both in-person and online.
Curriculum Evaluation Conduct comprehensive reviews of existing training materials and learning pathways, analyzing instructional effectiveness and recommending targeted improvements.
LMS Administration Administer, track, and report learning engagement and course completion data via learning management systems (LMS); partner with IT and instructional designers to optimize digital learning experiences.
Blended Learning Support Oversee the implementation and evaluation of blended learning solutions, integrating classroom, on-the-job, and digital modalities to meet the diverse needs of transit professionals.
Reporting & Analytics Develop data dashboards and deliver actionable reports to stakeholders, highlighting learning impact and compliance with regulatory or industry training standards.
Stakeholder Collaboration Partner with subject matter experts, trainers, instructional designers, and transit operations staff to ensure learning solutions align with job performance needs and safety requirements.
Continuous Improvement Leverage evaluation findings to inform the iterative enhancement of curricula, training processes, and assessment strategies. Remain current on industry trends, standards, and best practices for learning evaluation.
REQUIRED QUALIFICATIONS
DUTIES & RESPONSIBILITIESArea Description
Learning Outcomes Measurement Design and implement processes to evaluate knowledge transfer, skills acquisition, behavioral change, and organizational results as per the Kirkpatrick Model (Levels 1–4).
Assessment Design Create and validate formative and summative assessments (e.g., quizzes, skills checks, practical demonstrations) tailored for transit industry training curricula, both in-person and online.
Curriculum Evaluation Conduct comprehensive reviews of existing training materials and learning pathways, analyzing instructional effectiveness and recommending targeted improvements.
LMS Administration Administer, track, and report learning engagement and course completion data via learning management systems (LMS); partner with IT and instructional designers to optimize digital learning experiences.
Blended Learning Support Oversee the implementation and evaluation of blended learning solutions, integrating classroom, on-the-job, and digital modalities to meet the diverse needs of transit professionals.
Reporting & Analytics Develop data dashboards and deliver actionable reports to stakeholders, highlighting learning impact and compliance with regulatory or industry training standards.
Stakeholder Collaboration Partner with subject matter experts, trainers, instructional designers, and transit operations staff to ensure learning solutions align with job performance needs and safety requirements.
Continuous Improvement Leverage evaluation findings to inform the iterative enhancement of curricula, training processes, and assessment strategies. Remain current on industry trends, standards, and best practices for learning evaluation.
REQUIRED QUALIFICATIONS
- Education: Bachelor’s or Master’s degree in Education, Instructional Design, Industrial/Organizational Psychology, Learning Sciences, or a related field.
- Experience: Minimum 3 years' experience in learning evaluation, assessment development, or curriculum assessment—ideally within the transit industry or another safetycritical operational environment.
- Technical Skills: Proficiency with major LMS platforms (e.g., Cornerstone, Blackboard, Canvas, Moodle, SuccessFactors) and familiarity with eLearning authoring tools.
- Methodological Expertise: Thorough working knowledge of the Kirkpatrick Model and practical experience designing evaluations against all four levels.
- Blended Learning: Demonstrated success measuring learning effectiveness across both traditional and technologymediated learning environments.
- Analytical Skills: Strong data analysis capabilities—experience designing metrics, interpreting results, and presenting findings in accessible formats.
- Communication: Excellent writing, facilitation, and stakeholder engagement skills; ability to explain technical concepts in plain language.
- Direct work experience in the transit industry (e.g., public transportation agencies, rail, bus, light transit).
- Experience supporting training evaluations for regulatory compliance (e.g., FTA, OSHA).
- Familiarity with workforce development priorities and constraints unique to transit environments.
- Advanced credentialing (e.g., Certified Professional in Learning and Performance (CPLP), Kirkpatrick Certified Professional).
- Experience with data visualization and reporting tools (e.g., Tableau, Power BI).