What are the responsibilities and job description for the Evaluations Partner Manager (Youth AI Safety Institute) position at COMMON SENSE MEDIA?
Evaluations Partner Manager (Youth AI Safety Institute)
Common Sense Media is the leading nonprofit organization dedicated to improving the lives of kids and families by providing the research-backed information, education, and independent voice they need to thrive in the age of apps, algorithms, and AI. We rate, educate, and advocate for policies to protect and prepare kids online. Our ratings, research, and resources reach more than 150 million users globally, over 1.4 million educators, and more than 100,000 schools worldwide every year. Learn more at commonsense.org.
The Opportunity
Launched in May 2026, the Youth AI Safety Institute is Common Sense Media's newest addition to its programmatic pillar. The Institute establishes safety standards, builds open-source evaluations that AI developers can run against their models, independently tests AI products, and publishes the results to provide transparency and accountability. It is an independent research and testing ground dedicated to ensuring that the AI used by children is safe and developmentally appropriate.
The Evaluations Partner Manager will organize the operational execution of the Institute's evaluation work: managing the day-to-day workflow between the Institute and its external evaluator partners, ensuring that standards are received, rubrics are developed, evaluations are run, and results make their way back to the Institute in usable form.
This role sits at the operational center of the Institute's work, with a critical feedback loop to the Standards Analyst and a working interface with Common Sense Media's internal product and data teams. The Evaluations Partner Manager keeps the evaluation pipeline running: tracking progress, surfacing issues, routing feedback, and ensuring nothing falls through the cracks across multiple concurrent evaluation tracks.
Location: San Francisco, California
Reports To: Head of AI & Digital Assessments
Salary: $90,000–$110,000
Type: Full-time, exempt
What You'll Do
Evaluation Workflow Coordination
- Serve as the Institute's primary staff-to-staff operational contact for external evaluator partners, managing the flow of work across 3–4 concurrent evaluation partnerships at any given time.
- Track the status of each evaluation track (from standards handoff through rubric development, evaluation execution, and results delivery) maintaining clear visibility into where each project stands.
- Ensure evaluator partners have what they need from the Institute to proceed, and that the Institute receives deliverables on time and in expected formats.
- Develop and maintain systems for tracking evaluation timelines, deliverables, and open items across all active partnerships.
Standards-to-Rubric Handoff & Feedback Management
- Coordinate the handoff of Institute standards to evaluator partners, ensuring materials are complete, clearly documented, and appropriately contextualized for evaluation use.
- Surface and triage feedback from evaluators when standards raise questions of testability, scope, or clarity, routing issues to the Standards Analyst with enough context to act on them efficiently.
- Work closely with the Standards Analyst to track open feedback items, document how they are resolved, and ensure revised standards or clarifications make their way back to evaluators in a timely manner.
- Maintain a clear record of the standards-to-rubric translation process across all evaluation partnerships, including issues raised and how they were addressed.
Data & Results Management
- Coordinate the receipt of evaluation results and data from external partners, ensuring outputs arrive in formats that are usable by the Institute and its internal product and data teams.
- Understand the Institute's data systems and integration mechanisms, sufficient to identify when something isn't working as expected and know who to loop in.
- Serve as the operational liaison between external evaluators and Common Sense Media's internal product and data teams, translating between workflow needs on both sides.
- Track and organize evaluation outputs to support the Institute's reporting, publication, and standards-refinement work.
Program Tracking & Reporting
-
Maintain real-time visibility into the status of all active evaluation projects, with clear documentation of milestones, blockers, and upcoming deadlines.
-
Produce regular status updates for the Head of AI & Digital Assessments, flagging issues that require escalation or decision.
-
Identify and proactively surface operational bottlenecks before they delay evaluation timelines.
What We're Looking For:
Required Qualifications
- Education: Bachelor's degree in a relevant field (project management, public policy, computer science, research methods, or related).
- Experience: 3–5 years of experience in program coordination, research operations, or project management, preferably in a technical, research, or policy context.
- Workflow Management: Demonstrated ability to manage multiple concurrent project tracks with external partners, keeping complex workflows on schedule and well-documented.
- Technical Comprehension: Comfortable working with data systems and technical workflows: able to understand how data moves between systems, follow technical documentation, and communicate clearly with technical teams
- Communication: Strong written and verbal communication skills, with the ability to translate between technical and non-technical stakeholders clearly and efficiently.
- Organizational Excellence: Exceptional attention to detail and follow-through, with a track record of keeping complex, multi-party projects running smoothly.
Preferred Qualifications
- Experience coordinating research or evaluation workflows in an academic, policy, or technology context.
- Familiarity with AI evaluation, platform safety research, or technology risk assessment.
- Experience working with external research or technical partners in a coordination or liaison capacity.
- Ability to work directly with data formats, API documentation, and evaluation pipelines; capable of identifying integration issues and communicating precisely with engineering or data teams.
- Background in child safety, educational technology, or youth-focused research.
- Experience working in mission-driven or nonprofit organizations.
Core Competencies
- Operational Rigor: Tracks the details across multiple concurrent workstreams without losing sight of the bigger picture.
- Proactive Problem-Solving: Identifies issues early, surfaces them clearly, and follows through until they're resolved.
- Clear Communication: Translates between external evaluators, internal staff, and technical teams with precision and without creating confusion.
- Collaborative Approach: Works fluidly across a range of internal and external partners, serving as a reliable operational hub without needing to own strategic decisions.
- Systems Thinking: Understands how the pieces connect (standards, rubrics, evaluations, data, publishing) and manages their own work accordingly.
- Adaptability: Comfortable operating in a fast-moving environment where evaluation methods, partners, and priorities continue to evolve.
What We Offer
- The chance to work with talented, passionate professionals.
- A great health and welfare benefits package, including medical, dental, vision, a matching 401(k), and other key benefits.
- An organization that offers work/life balance.
- The opportunity to really make a difference in the lives of kids and families!
Common Sense Media provides equal employment opportunities to all qualified individuals and prohibits discrimination and harassment of any type without regard to race, color, religion, sex, gender identity, sexual orientation, pregnancy, age, national origin, physical or mental disability, military or veteran status, genetic information, or any other protected classification or characteristic protected by federal, state, or local laws.
Common Sense Media will also consider for employment qualified applicants with arrest and conviction records. However, job offers are made on the condition that the applicant subsequently passes a criminal background check. If the background check indicates a prior criminal conviction, we will conduct an individualized assessment to determine whether the conviction should result in denial of employment. Pursuant to the San Francisco Fair Chance Ordinance, we will consider employment for qualified applicants with arrest and conviction records.
Salary : $90,000 - $110,000