What are the responsibilities and job description for the AI Test Engineer position at Stanley David and Associates?
Job Description:
Role Summary
Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.
Key Responsibilities
- Design and execute test plans covering AI model outputs, data correctness, and application functionality.
- Create automated tests for APIs and UI where appropriate; maintain regression suites.
- Validate business logic, edge cases, and non-functional requirements (performance, reliability).
- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
- Triage defects, document reproducible steps, and partner with engineers to resolve issues.
- Contribute to release readiness, quality gates, and continuous improvement of testing practices.
Required Qualifications
- 3 years in QA/Test Engineering for web/services-based applications.
- Experience with test automation tools (Selenium) and API testing (Postman or similar).
- Strong understanding of test case design, defect lifecycle, and agile QA practices.
- Familiarity with tracking tools (JIRA) and test documentation.
- Ability to reason about data quality and validate outputs against requirements.
Preferred / Nice to Have
- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
- Performance testing experience (load, stress) and observability basics.
- Knowledge of accessibility testing for UI.
Core Skills (from POD sheet)
Selenium, Postman, Test Cases, JIRA, Manual Testing
Salary : $100,000 - $120,000