What are the responsibilities and job description for the Director, AI Quality Engineering - REMOTE position at Lenovo and Careers?
General Information
Req #
WD00092436
Career Area:
Software Engineering
Country/Region:
United States of America
State:
North Carolina
City:
Morrisville
Date:
Friday, December 5, 2025
Working Time:
Full-time
Additional Locations:
- United States of America - North Carolina - Morrisville
Why Work at Lenovo
We are Lenovo. We do what we say. We own what we do. We WOW our customers.
Lenovo is a US$69 billion revenue global technology powerhouse, ranked #196 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992) (ADR: LNVGY).
This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit www.lenovo.com, and read about the latest news via our StoryHub.
Description and Requirements
About Our Team
Lenovo’s AI Engineering organization is building Quantum — a hybrid AI platform that spans Windows, Android, and Cloud. As Director of AI Quality Engineering, you will establish and lead the quality discipline that ensures we ship reliable, safe, and high-confidence AI experiences across millions of devices.
This is a technical leadership role responsible for test strategy, automation, scenario validation, and evaluation frameworks for AI models and agentic behaviors. You will architect the test systems and methodologies that guarantee end-to-end quality across the entire Quantum stack.
Location: Chicago, IL and Morrisville, NC are highly preferred. Open to remote work in the US with travel.
What You'll Do
- Build and lead the AI Quality Engineering organization, covering functional testing, scenario testing, automation, and regression.
- Define and execute a comprehensive AI testing strategy across Windows, Android, cloud, and cross-device experiences.
- Architect the AI automation framework for UI, system interactions, agent flows, and multimodal input/output validation.
- Own model and agent evaluation pipelines, including accuracy, latency, grounding, hallucination detection, safety checks, and guardrail tests.
- Build tooling for validating local vs cloud inference paths, RAG reliability, perception models, and agent orchestration flows.
- Partner with SRE & Delivery to define quality gates, release criteria, and gating policies for the release train.
- Create a unified scenario library across features like Learning Zone, Notion integration, cross-device continuity, Local Agent, and more.
- Develop a risk-based testing strategy to support parallel prototyping while maintaining high confidence in integration and release.
- Work closely with Platform, Core Intelligence, Experience, and Cloud teams to identify quality gaps early and enforce quality standards.
- Lead the cultural shift toward “testability by design” and raise the quality bar across all engineering teams.
Basic Qualifications
- 12 years of experience in quality engineering, test automation, or AI/ML validation, with at least 5 years leading teams.
- Strong background in building automation frameworks for complex distributed or cross-device products.
- Hands-on experience testing AI models, RAG/LLM systems, perception models, or agentic behaviors is a strong plus.
- Deep experience with UI automation (Windows, Android), API testing, performance validation, and scenario-based testing.
- Experience working with telemetry, logs, and debugging across large-scale systems.
Preferred Qualifications
- Ability to work across geos and manage cross-functional alignment with platform, intelligence, cloud, and experience teams.
- Proven success driving quality culture in fast-paced engineering organizations.
- 25% global travel ability
The base salary budgeted range for this position is $220K - $320K. Individuals may also be considered for bonus and/or commission.
Lenovo’s various benefits can be found on www.lenovobenefits.com.
In compliance with Colorado's EPEWA, the expected application deadline for this position is January 5, 2026. This applies to both external and internal candidates.
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, national origin, status as a veteran, and basis of disability or any federal, state, or local protected class.
Additional Locations:
- United States of America - North Carolina - Morrisville
Salary : $220,000 - $320,000