Demo

AI Test Engineer || W2 Only || REMOTE ||

Xlysi
Chicago, IL Remote Full Time
POSTED ON 1/10/2026
AVAILABLE BEFORE 2/10/2026
Job Summary:

We are seeking a skilled IVR / Conversational AI Test Engineer with strong hands-on experience in Cyara, IVR testing, and Google Dialogflow authoring. The ideal candidate will be responsible for designing, executing, and maintaining automated and manual test cases for voice and chatbot platforms, ensuring high-quality conversational experiences across multiple channels.



Key Responsibilities:
• Develop and execute test strategies and test cases for IVR and chatbot applications.
• Perform end-to-end testing of conversational flows using Cyara and Dialogflow.
• Validate voice call routing, transcription accuracy, and conversational logic.
• Collaborate with developers, product owners, and QA teams to ensure test coverage across voice and digital channels.
• Author, test, and optimize Dialogflow intents, entities, and fulfillment logic.
• Automate regression tests using Cyara or similar testing tools.
• Document defects, maintain test artifacts, and participate in defect triage meetings.
• Provide recommendations for improving test automation, conversational flow, and customer experience.



Required Skills & Experience:
• 5–8 years of overall QA experience, with at least 3 years in IVR or Conversational AI testing.
• Strong hands-on experience with Cyara for IVR and chatbot test automation.
• Experience in Google Dialogflow (CX or ES) authoring, testing, and tuning.
• Knowledge of SIP, call flows, and telephony systems.
• Familiarity with API testing, Postman, and test management tools (e.g., Jira, Zephyr).
• Strong analytical, troubleshooting, and communication skills.
• Experience working in Agile/Scrum environments.

Salary.com Estimation for AI Test Engineer || W2 Only || REMOTE || in Chicago, IL
$105,220 to $123,647
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a AI Test Engineer || W2 Only || REMOTE ||?

Sign up to receive alerts about other jobs on the AI Test Engineer || W2 Only || REMOTE || career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$184,796 - $233,226
Income Estimation: 
$179,606 - $233,815
Income Estimation: 
$148,779 - $177,789
Income Estimation: 
$113,143 - $125,853
Income Estimation: 
$72,265 - $83,772
Income Estimation: 
$84,546 - $99,351
Income Estimation: 
$84,546 - $99,351
Income Estimation: 
$104,692 - $122,242
Income Estimation: 
$104,692 - $122,242
Income Estimation: 
$128,874 - $152,513
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Xlysi

  • Xlysi Austin, TX
  • ServiceNow Developer Austin, TX~Sunnyvale, CA Experience with SDLC ServiceNow platform developer with experience in implementing the ServiceNow BCM (Busine... more
  • 12 Days Ago

  • Xlysi Spring, TX
  • W2 Only. Location's: Spring, TX & Dallas, TX. Hybrid. Contract role. Job Summary: We are seeking an experienced Sr. Network Engineer with deep expertise in... more
  • 12 Days Ago

  • Xlysi Chicago, IL
  • We are seeking an experienced Full Stack Developer with expertise in Adobe Experience Manager (AEM) to join our team. The ideal candidate should have a str... more
  • 14 Days Ago

  • Xlysi Spring, TX
  • Responsibilities: Design, configure, and support enterprise routing & switching infrastructure , SDWAN , and Spine-Leaf data center networks Operate and tr... more
  • 14 Days Ago


Not the job you're looking for? Here are some other AI Test Engineer || W2 Only || REMOTE || jobs in the Chicago, IL area that may be a better fit.

  • Xlysi Chicago, IL
  • Responsibilities: Develop and maintain end-to-end automated test scripts using Playwright (JavaScript/TypeScript). Perform functional, regression, UI, API,... more
  • 30 Days Ago

  • Xlysi Chicago, IL
  • Python Automation Engineer Fully Remote. Contract role. Skill sets required: At least 3 years experience in front-end (UI) and back-end automation (APIs) A... more
  • 1 Month Ago

AI Assistant is available now!

Feel free to start your new journey!