What are the responsibilities and job description for the Medical Experts - USA position at Braintrust?
About Turing:
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview:
We are seeking experienced US-based Medical Doctors (MD) or international equivalent (MBBS, MBChB, Medical Diploma, etc.) to help evaluate and enhance large language model (LLM) outputs in the medical domain. You’ll assess AI-generated clinical content for medical accuracy, safety, and relevance — contributing to the development of responsible AI in healthcare.
What You'll Do Day-to-Day:
- Review AI-generated medical text for accuracy, harmfulness, and completeness, with focus on the medical field.
- Evaluate diagnoses, treatment plans, and summaries for medical cases.
- Provide expert feedback to improve medical integrity and safety of LLM outputs.
- Collaborate with AI researchers and clinicians to align model performance with evidence-based medical standards.
Requirements:
- Based in the US (mandatory).
- Medical Doctor (MD) or international equivalent (MBBS, MBChB, Medical Diploma, etc.)
- Must be fully licensed and practicing medicine within the USA.
- Minimum 1 year post-residency experience practicing as a Medical Doctor / General Physician (no specific specialization required).
- Strong attention to detail
- Technically savvy—able to navigate web-based annotation platforms, use image zoom/tools, follow detailed guidelines, and accurately complete structured questionnaires.
- Experience in medical content review, clinical research, annotation or AI/ML evaluation preferred.
Interview Process:
- Complete an interest check form (10 minutes)
- Internal review from Turing
- Selected for hire!
Salary : $120