Chatbot QA Engineer

The Chatbot QA Engineer is responsible for testing complex AI software and system requirements and analyzing large datasets, including integration testing to meet functional and non-functional chatbot requirements. In this role you must demonstrate technical and analytical skills as well as the ability translate between technology and business terms for the stakeholders.

Responsibilities:

• Validate virtual chatbot intents, entities, grammars, and end to end workflows with fallback behaviors.
• Creates and optimizes test processes including defect management and reporting
• Ensures alignment and sign off for test cases from business and other stakeholders
• Manages test execution and resolves, communicates, or escalates any issues that may result in test plan variance
• Designs test data and ensure data compliance requirements are met on all levels of test environments
• Develop and execute a comprehensive testing strategy for virtual assistant application, encompassing functional, performance, regression, and exploratory testing.
• Oversee the execution of test cases, ensuring proper test planning and adherence to testing timelines.

Desired Experience:

• Familiar with Behavior Driven Development (BDD) and Test Driven Development (TDD) methodologies
• Experience with testing frameworks and tools specific to testing APIs, NLP/NLU, GenAI, and chatbot applications.
• Experience with agile development methodologies, DevOps practices and tools such as ALM Octane.
• Strong experience in developing and executing testing strategies for complex applications.
• Knowledge of data versioning and data management practices.
• Proficiency in test case design, test execution, and test management tools including AI-assisted test creation with GitHub Copilot.
• Experience with automation testing tools such as Selenium, Playwright, or PyTest.
• Financial domain knowledge is nice to have