Demo

Member of Technical Staff - Data and Evals

Reflection AI
San Francisco, CA Full Time
POSTED ON 11/29/2025 CLOSED ON 12/27/2025

What are the responsibilities and job description for the Member of Technical Staff - Data and Evals position at Reflection AI?

Our Mission

Reflection’s mission is to build open superintelligence and make it accessible to all.

We’re developing open weight models for individuals, agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind, OpenAI, Google Brain, Meta, Character.AI, Anthropic and beyond.

About The Role

  • Build the data and evaluation systems that determine and drive model quality across pre-training and post-training.
  • Develop rigorous and generalizable evaluation frameworks for reasoning, alignment, and usefulness.
  • Collaborate closely with pre-training, post-training, and applied teams to close the loop between data, evals, and model behavior.
  • Push the boundaries of what’s measurable, from synthetic evals to human feedback and real-world interaction data.

About You

  • Deep understanding of data quality, curation, and measurement in the context of large-scale ML.
  • Experience building robust data or evaluation pipelines for foundation models or similar large systems.
  • Familiarity with evaluation methodologies, including static benchmarks, human preference evals, and agentic tasks.
  • High agency and thrive in a fast-paced startup environment; bias for impact over process.
  • Excited to work in a new frontier lab, defining how we measure and accelerate progress toward more capable models.
  • Collaborative, detail-oriented, and motivated by building the feedback loops that make models truly improve.

What We Offer

We believe that to build superintelligence that is truly open, you need to start at the foundation. Joining Reflection means building from the ground up as part of a small talent-dense team. You will help define our future as a company, and help define the frontier of open foundational models.

We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.

  • Top-tier compensation: Salary and equity structured to recognize and retain the best talent globally.
  • Health & wellness: Comprehensive medical, dental, vision, life, and disability insurance.
  • Life & family: Fully paid parental leave for all new parents, including adoptive and surrogate journeys. Financial support for family planning.
  • Benefits & balance: paid time off when you need it, relocation support, and more perks that optimize your time.
  • Opportunities to connect with teammates: lunch and dinner are provided daily. We have regular off-sites and team celebrations.

Member of Technical Staff, Pre-Training Data
Cohere -
San Francisco, CA
Member of Technical Staff, Data / Context Engineer
Harper (YC W25) -
San Francisco, CA
Member of Technical Staff - Data Quality Engineer (Pre-training)
Reflection AI -
San Francisco, CA

Salary.com Estimation for Member of Technical Staff - Data and Evals in San Francisco, CA
$46,104 to $55,940
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Member of Technical Staff - Data and Evals?

Sign up to receive alerts about other jobs on the Member of Technical Staff - Data and Evals career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$36,436 - $44,219
Income Estimation: 
$50,145 - $86,059
Income Estimation: 
$48,515 - $60,705
Income Estimation: 
$56,489 - $71,327
Income Estimation: 
$70,310 - $88,223
Income Estimation: 
$66,679 - $90,237
Income Estimation: 
$70,310 - $88,223
Income Estimation: 
$88,950 - $110,401
Income Estimation: 
$84,958 - $111,603
Income Estimation: 
$72,620 - $96,681
Income Estimation: 
$111,369 - $141,168
Income Estimation: 
$117,871 - $153,580
Income Estimation: 
$109,939 - $144,341
Income Estimation: 
$114,500 - $144,633
Income Estimation: 
$88,950 - $110,401
Income Estimation: 
$109,186 - $139,009
Income Estimation: 
$115,336 - $159,446
This job has expired.
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Reflection AI

  • Reflection AI York, NY
  • Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all . We’re developing open weight models for individuals, ag... more
  • 16 Days Ago

  • Reflection AI San Francisco, CA
  • Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all . We’re developing open weight models for individuals, ag... more
  • 16 Days Ago

  • Reflection AI Washington, DC
  • Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all . We’re developing open weight models for individuals, ag... more
  • 3 Days Ago

  • Reflection AI York, NY
  • Our Mission Reflection’s mission is to build open superintelligence and make it accessible to all . We’re developing open weight models for individuals, ag... more
  • 3 Days Ago


Not the job you're looking for? Here are some other Member of Technical Staff - Data and Evals jobs in the San Francisco, CA area that may be a better fit.

  • Anthropic San Francisco, CA
  • About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and ... more
  • 12 Days Ago

  • Cohere San Francisco, CA
  • Who are we? Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are bui... more
  • 4 Days Ago

AI Assistant is available now!

Feel free to start your new journey!