What are the responsibilities and job description for the Tech Lead (Python, Java, C, C++ or JavaScript) - AI Training position at Braintrust?
Job Description:
We are seeking multiple Tech Leads (Coders) to help lead our GenAI code initiatives as hands-on experts.
You’ll write and refine code, design automated evaluation frameworks, and partner with research, engineering, and product to improve code-centric LLM performance and reliability.
- To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
Responsibilities:
- Write, evaluate, and rewrite code to solve complex, real-world problems (hands-on).
- Build frameworks, test suites, and benchmarks to validate model-generated code.
- Analyze and improve correctness, efficiency, and security of human- and AI-written code.
- Define and track code quality metrics.
- Collaborate cross-functionally to integrate feedback and drive model improvements.
- Accelerate validation and refinement of code-generating models; ensure production readiness; drive innovation in GenAI use cases.
Requirements:
- 5 years building and shipping complex software solutions.
- Strong proficiency in at least one: Python, Java, C, C , JavaScript.
- Experience creating test harnesses; evaluating code for correctness, efficiency, security.
- Familiarity with LLMs for code (generation, fine-tuning, evaluation) preferred.
- Preferred: STEM/domain expertise; data analysis/visualization; SQL/databases; JSON, HTML, Markdown; web viz platforms; data libraries.
- Senior/tech-lead level; comfortable with smaller, high-complexity datasets.
- Nice-to-have: “technical raters” with strength in JavaScript/JSON, HTML, Markdown.
Salary : $75 - $90
AI Product Enablement Lead
TWG Global AI -
York, NY
Associate Internal Auditor
Lead -
York, NY
Senior Enterprise Risk Governance Specialist
Lead -
York, NY