QA Analyst - Conversational AI / Chatbot Testing

Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for Eliassen Group. Clicking "Apply Now" or "Read more" on Lensa redirects you to the job board/employer site. Any information collected there is subject to their terms and privacy notice.

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut: http://careers.eliassen.com/OpDWMP

• Description
• Recommended Jobs
  
  

Description

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $60 / hr. w2

Responsibilities

• Define functional and non-functional test strategies for the conversational AI platform.
• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.
• Conduct rigorous testing of conversational AI models, including:
• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.
• Performance testing to evaluate response times, system load, and resource utilization.
• Usability testing to assess the user experience and identify areas for improvement.
• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.
• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.
• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.
• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.
• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.
• Track and manage bug resolution and feature enhancements.
• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.
• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.
• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.
• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.
• Research and explore new testing methodologies and tools to enhance the QA process.
  
  

Experience Requirements

• At least 5 years of experience in software testing and quality assurance methodologies.
• Knowledge of AI and machine learning concepts, particularly in natural language processing.
• Expertise in testing conversational AI or chatbot systems.
• Excellent analytical and problem-solving abilities.
• Strong communication and collaboration skills.
• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.
• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).
  
  

Education Requirements

• Bachelor's degree in computer science, information technology, or related field.
  
  

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact InfoSec@eliassen.com.

About Eliassen Group

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!

If you have questions about this posting, please contact support@lensa.com