What are the responsibilities and job description for the Retail SME - AI Evaluation (US-Remote) position at Braintrust?
Job Description:
We are seeking multiple Retail Subject Matter Experts (SME) to train, evaluate, and fine-tune AI models for retail use cases (e.g., virtual assistants, demand forecasting, customer insights).
The SME ensures domain accuracy, contextual understanding, and alignment with business goals across merchandising, operations, supply chain, store management, and customer experience.
- To Note: This is for an immediate project need. Project is approved for 3-months initially, with possibility to extend based on project/client demands.
Responsibilities:
- Act as the retail domain expert during AI training/fine-tuning to ensure contextual accuracy and industry relevance.
- Build retail knowledge bases, taxonomies, and ontologies reflecting standards and best practices.
- Annotate/label/validate datasets (e.g., categories, inventory terms, pricing, promotions).
- Collaborate with AI/ML teams on data strategies, evaluation metrics, and prompt design for retail apps.
- Review model outputs; identify errors, ambiguities, and opportunities to improve reasoning/performance.
- Partner with product/analytics to tie AI capabilities to outcomes (sales, demand, engagement).
- Track trends in retail tech and AI; propose practical, innovative implementations.
Requirements:
- Bachelor’s/Master’s in Business, Retail Management, Supply Chain, Data Analytics, or related field.
- 5 years of retail experience (merchandising, operations, category management, supply chain, or e-commerce).
- Ability to translate business processes into structured data requirements.
- Strong analytical and communication skills for technical and non-technical audiences.
- Experience with AI/ML concepts (annotation, prompt design, model evaluation) preferred.
- Familiarity with ERP, POS, CRM, or inventory management systems is a plus.