Demo

AI Research engineer

Cerebro
San Francisco, CA Full Time
POSTED ON 6/6/2026
AVAILABLE BEFORE 7/5/2026

AI Researcher – Data, Evaluation & Alignment


We're building critical infrastructure used by leading AI research organizations to improve the capabilities, reliability, and alignment of frontier language models.


Our team works directly on the datasets, evaluation systems, and feedback loops that determine how state-of-the-art models are trained, measured, and improved. As an early team member, you'll have unusual ownership, direct exposure to cutting-edge research, and the opportunity to influence how next-generation AI systems are developed.


The Opportunity

Most AI research focuses on models. We focus on the signals that shape them.

This role sits at the intersection of AI research, evaluation science, reinforcement learning, and data generation. You'll work on identifying model weaknesses, designing experiments to expose them, and creating the datasets and evaluation frameworks that help researchers push model performance forward.


Your work will directly impact large-scale training runs and research decisions at some of the most advanced AI organizations in the world.


What You'll Work On

  • Design novel datasets that reveal meaningful model failure modes across domains such as reasoning, coding, finance, and enterprise workflows.
  • Develop evaluation frameworks that go beyond static benchmarks and provide actionable insights into model capabilities.
  • Create and refine reward signals, rubrics, and measurement systems for RLHF, RLAIF, and related post-training methods.
  • Run experiments to understand how data quality, structure, and selection influence model behaviour.
  • Build quantitative approaches for measuring dataset quality, diversity, robustness, and downstream impact.
  • Investigate annotator behaviour and human-feedback dynamics to improve training signal quality.
  • Partner closely with frontier AI research teams to translate high-level research goals into concrete datasets and evaluation protocols.


Who We're Looking For

We're particularly excited about candidates who are early in their research careers but already demonstrate exceptional research ability and curiosity.

Examples might include:

  • Undergraduate researchers with outstanding AI/ML research experience.
  • Master's students or graduates pursuing advanced work in machine learning, reinforcement learning, NLP, evaluation, or alignment.
  • Researchers from benchmarking, AI safety, or model evaluation organizations.
  • Individuals who have interned or worked in reinforcement learning, alignment, evaluation, or frontier-model environments.

Strong Signals

  • Deep interest in understanding how data drives model behaviour.
  • Familiarity with LLM training, RLHF, reward modelling, evaluation methodologies, or alignment research.
  • Experience designing experiments and extracting insight from noisy or ambiguous results.
  • Strong quantitative reasoning and scientific thinking.
  • Comfort operating across multiple domains and problem spaces.
  • A builder mentality with a bias toward rapid experimentation and iteration.

Particularly Relevant Backgrounds

Experience with areas such as:

  • LLM evaluation and benchmarking
  • AI safety and alignment
  • Reinforcement learning
  • Human feedback systems
  • Model auditing and failure analysis
  • Frontier model research infrastructure

Why This Role

  • Work on problems that directly influence how state-of-the-art AI systems are trained and evaluated.
  • Collaborate with some of the world's leading AI research teams.
  • Operate with significant autonomy and ownership.
  • Join at an early stage where individual contributions have outsized impact.
  • Competitive compensation and meaningful equity participation.


If you're fascinated by why models succeed, fail, and improve—and you believe better data and evaluation are among the highest-leverage problems in AI—this role offers a unique opportunity to shape the future of frontier model development.

Salary : $250,000 - $280,000

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Research engineer?

Sign up to receive alerts about other jobs on the AI Research engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Cerebro

  • Cerebro Palo Alto, CA
  • Seeking a experienced Researcher for a frontier lab coming out of stealth to support an experienced Head of AI who's ex-Anthropic to work on innovative RL ... more
  • 7 Days Ago


Not the job you're looking for? Here are some other AI Research engineer jobs in the San Francisco, CA area that may be a better fit.

  • Together AI San Francisco, CA
  • About The Role This is a research engineering role with direct production impact. You won’t be publishing ideas in isolation—you will translate new RL algo... more
  • 7 Days Ago

  • Liquid AI San Francisco, CA
  • About Liquid Labs Research has been core to Liquid AI from the beginning. Liquid Labs gives that work a formal home; an internal research accelerator drivi... more
  • 17 Days Ago

AI Assistant is available now!

Feel free to start your new journey!