What are the responsibilities and job description for the AI Automation Engineer position at KTek Resourcing?
Job Title: AI Automation Engineer
Location: Bellevue, WA
Onsite 5days
Client: T-Mobile
Fulltime Role
Salary: DOE
Experience: Experience in IT minimum- 15 Years
AI Experience- 3 Years
Must-have Skills:
ETL Pipeline
ML /AI
AI Ops (ML Ops, Agent Ops & LLM Ops) Workflow
Python , SQL
System Design,
MCP Client server design
Good to
have Skills
AIOps/MLOps
Observability for AI
Nice to
have Skills
Bash
JD
• Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
• Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
• Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
• Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.