What are the responsibilities and job description for the AI Tester (Onsite) position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Business Enterprize Inc., is seeking the following. Apply via Dice today!
Greetings from Business Enterprize Inc.
We are currently looking for a AI Tester (ONSITE) for our Client in Irvine, CA. Please submit your resume along with 3 references and expected rate per hour.
Position: AI Tester
Location: Irvine, CA (Onsite is mandatory )
Duration: 12 Months
Key Responsibilities -
Greetings from Business Enterprize Inc.
We are currently looking for a AI Tester (ONSITE) for our Client in Irvine, CA. Please submit your resume along with 3 references and expected rate per hour.
Position: AI Tester
Location: Irvine, CA (Onsite is mandatory )
Duration: 12 Months
Key Responsibilities -
- Test AI outputs for accuracy, consistency, edge cases, and failure modes
- Validate training and inference data quality; identify bias and data leakage risks
- Define and execute model evaluation and regression tests
- Reuse and expand the Golden Dataset for regression testing across builds, prompt/model changes, and releases.
- Test AI behavior within end‑to‑end user workflows and integrations
- Support Responsible AI testing (fairness, explainability, compliance)
- Monitor model performance post‑release (drift, feedback, regressions)
- Test automation coverage
- Communicate risks and test findings clearly to stakeholders
- Track & report quality metrics such as accuracy, precision (and recall where applicable), clearly highlighting missing, incorrect, or hallucinated content.
- QA/test planning, exploratory testing, and UAT experience
- AI/ML fundamentals and evaluation metrics literacy
- Data analysis and model behavior reasoning
- Ability to test GenAI prompts and outputs (preferred)
- Strong domain knowledge and user‑centric mindset
- Clear documentation and communication skills
- 3–7 years in QA, testing, or quality roles
- Experience with AI/data‑driven products preferred
- ISTQB, AI/Data, or Responsible AI training is a plus